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DEVELOPMENT OF A BEHAVIOR TAXONOMY FOR 
DESCRIBING HUMAN TASKS: 


A CORRELATIONAL-EXPERIMENTAL APPROACH: 


EDWIN A. FLEISHMAN 


American Institutes for Research, Washington, D. C. 


The need for identifying a set of unifying dimensions underlying skilled be- 


havior is discussed. The issues 
from laboratory to operational t 
of experimental and correlationa 
ceptual framework and research 
on perceptual-motor à 


questions discussed. The integrative nat 
y of studies, in laboratory and operational situa- 


of skill learning and retention to the effects of 


illustrated by a wide variet: 
tions, ranging from those 
environmental factors on 


human performance, 


bear on problems of generalizing principles - 
asks and from one task to another. Combinations 
] approaches appear to be required. The con- 

strategy utilized by the author in his research 
bilities is described and its relevance to taxonomy 


ure of the framework developed is 


and in the standardization of 


laboratory tasks for performance assessment. 


opa; undamental prerequisite to the effective 
куагы of any man-machine system is the 
skilled OR; performance, and retention of 
gists h behaviors. For many years psycholo- 
orma: ave studied human learning and per- 
йш often in applied contexts, under 
and э task and environmental conditions, 
nq 1276 accumulated vast quantities of data. 
explored аз new systems are conceived for the 
Mand ation of space, for defense, for com- 
the а and control, it appears that much of 
Past ccumulated data and experience of the 
Proble, re largely inapplicable and that the 
er m of skill identification, training, and 
Scratch, ance must be restudied almost from 
Waste of Why is this the case? Why such a 
wet prior findings? | 

Оен rficially, each new system differs from 
ystems with respect to application, mIs- 


1 

апа Сопот to symposium "Task Taxonomy 
at the 5 implications for Military Requirements, 
tion ые Psychological Association Conven- 
Paper . 5280, September 1965. Preparation of this 
Ме уаз facilitated by Contract No. DA-49-193- 
ang 1032 With the Army Surgeon General’s Office, 


ву, National Science Foundation Grant No. 


sion, and technology, and apparently in its 
task demands on its human operators. No 
two task analyses are ever quite the same. 
No two systems ever have identical job re- 
quirements. No training device or simulator 
ever quite seems to fit the requirements of 
any system except the one for which it was 
developed. Is it reasonable to conclude that 
the tasks of men in systems are 50 varied 
that there are no common dimensions with 
respect to the basic abilities required, the 
types of training needed for job proficiency, 
or the degradation of skilled behavior under 
given environmental conditions? 

The present lack of a set of unifying di- 
mensions underlying skilled behavior would 
appear to require one to answer the question 
in the affirmative. Why else have so many 
prominent psychologists (e.g., Melton, Fitts, 
Gagné, Miller) called so often for so long 
for a method for classifying human tasks— 
for a “task taxonomy"? 

The problem is not only one of finding 
ways to generalize principles from one opera- 
tional system to another. It also involves the 
generalization of findings from the laboratory 
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to operational tasks. One reason why much of 
current learning research in the experimental 
laboratory appears so sterile to those who 
try to apply it to real-life training situations 
is the lack of concern by learning psycholo- 
gists for the problem of task dimensions. This, 
of course, is often true for laboratory studies 
of the effects of environmental factors, the 
effects of motivational variables, the effects 
of drugs, etc., on human performance. It is not 
too long ago when a favorite distinction was be- 
tween “motor” and “mental” tasks or between 
"cognitive" and “noncognitive” tasks. Such 
distinctions are clearly not very helpful in gen- 
eralizing results to new situations, which 
involve a complex array of tasks and skills 
not adequately described by such all-inclusive 
terms. Tasks selected in laboratory research 
are not often based on any clear rationale 
about the class of task or skill represented, 
Most learning theory is devoid of any con- 
cern about task dimensions, and it is this 
deficiency which, many feel, makes it so 
difficult to apply these theories in the real 
world of tasks and people. What is needed is 
a learning and performance theory which 
ascribes task dimensions а central role. 

At the other extreme, one finds task de- 
scriptions, often developed by job and SyS- 
tems analysts, which are highly detailed and 
highly specific. These are extremely useful 
and necessary for a variety of purposes, but 
their Very specificity limits the kinds of gen- 
eralizations Which can be made to new classes 
of skills and tasks, 

i Sc нк лоч of man-task 
ertani NEHME an E Beers of functions 
direction. Thus, Са, ni 1964] pias 
categories like diserimination itn gee? 

discrimination, identification, 
Sequence learning, problem solving; and 
Robert Miller (1965) uses terms like scanning, 
identification of cues, interpretation, short- 
term and long-term memory, decision makin 
etc. Psychologists working with the Lockheed 
approach use dimensions like tracking, vigil- 
ance, arithmetic, and pattern comparison 
(Mangelsdorf, 1965). 

These categories may turn out to be highly 
useful in both (а) organizing psychological 
data into categories of consistent principles, 
or (5) allowing more dependable predictions 


from laboratory to operations and from one 
operation to another. The demonstration, of 
course, still needs to be made. One needs to 
recognize, naturally, that these approaches 
are initially arm-chair, rational descriptive 
approaches. And there is nothing wrong with 
this, provided the necessary experimental 
predictive work is carried out to test the. 
utility of these systems. However, I am 
skeptical that any small number of categories 
is going to be successful. For example, one of 
the most careful systematic approaches is 
that developed by Alluisi (1965) in his ex- 
tension of the Lockheed approach. I am sure 
that this work represents a major step for- 
ward in task standardization and that we will 
learn much from this work. However, the 
basic battery will consist of from six to eight 
tests covering categories such as vigilance 
processes, memory functions, communication 
functions, intellectual functions, procedural 
functions, etc. Everything known about the 
correlations among human performances in- 
dicates a greater degree of specificity than 
this and considerable diversity of function 
within these categories. Since there are many 
types of human functions within each sub- 
area, one probably cannot generalize too far 
within each area. It is my feeling that we 
will just have to admit that human perform- 
ance is complex and consists of many com- 
ponents. The problem is to simplify the de- 
Scription as far as we can, seeking all the 
while to find the limits and generality of the 
categories developed. And the selection of 
measures, diagnostic and representative of 
these categories, is an empirical rather than 
an arm-chair question. 

The major point of this presentation is that 
there are empirical-experimental approaches 
to developing task taxonomies and that these 
represent alternative ways of going about it. 
It is my feeling that we already know quite 
a bit about task dimensions from experi- 
mental-correlational studies already com- 
pleted, and that these allow us to be much 
more specific about task dimensions than do 
the more general categorical terms previ- 
ously described. And I believe that combina- 
tions of experimental and correlational. 
methods can develop a taxonomy of human 
performance which is applicable to a large 
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Variety of tasks and situations. Furthermore, 
Such an approach yields empirical indexes 
(e.g., factor loadings) for diagnostic measures 
of the categories developed. I would like to 
elaborate these issues. 


Conceptual and Methodological Framework 


First, I would like to define some concepts 
үш have been developed. Second, I would 
Ike to present some illustrative data of past 
Fm Current work, and finally point up some 
directions in which we might go. 

I find it useful to distinguish between the 
ing of ability and skill. As we use the 

Tm, ability refers to a more general trait 

r^ the individual which has been inferred 
| е Certain response consistencies (e.g. 
Orrelations) on certain kinds of tasks. These 
are fairly enduring traits which, in the adult, 
abi More difficult to change. Many of these 

piss are, of course, themselves a product 
of learning and develop at different rates, 
mainly during childhood and adolescence. 
Оте abilities (eg. color vision) depend 
са Оп genetic than learning factors, but 

Ost abilities depend on both to some degree. 
те any case, at a given stage of life, they 

Présent traits or organismic factors which 

© individual brings with him when he 
m 5 to learn a new task. These abilities are 
€ €d to performances in a variety of human 
visual Р ог example, the fact that spatial 
бт m has been found related to per- 
Pi on such diverse tasks as aerial 

ao ai, blueprint reading, and dentistry, 
es this ability somehow more basic. 
i term skill refers to the level of pro- 
üiske О оп a specific task or limited group of 
ori S. As we use the term skill, it is task 
ented. When we talk about proficiency in 
Ч Ng an airplane, in operating a turret lathe, 

im playing basketball, we are talking about 
с Specific skill. Thus, when we speak of 

Wiring the skill of operating a turret lathe, 
Seen that this person has acquired the 
task ence of responses required by this specific 
Volve, һе assumption is that the skills in- 
in In complex activities can be described 
sien of the more basic abilities. For 
айаш le, the level of performance а man can 
asie „02 à turret lathe may depend on his 

© abilities of manual dexterity and motor 


coordination. However, these same basic 
abilities may be important to proficiency in 
other skills as well. Thus, manual dexterity 
is needed in assembling electrical components, 
and motor coordination is needed to fly an 
airplane. 

Implicit in the previous analysis is the 
important relation between abilities and learn- 
ing. Thus, individuals with high manual 
dexterity may more readily learn the specific 
skill of lathe operation. The mechanism of 
transfer of training probably operates here. 
Some abilities may transfer to the learning 
of a greater variety of specific tasks than 
others. In our culture, verbal abilities are 
more important in a greater variety of tasks 
than are some other types of abilities. The 
individual who has a great many highly de- 
veloped basic abilities can become proficient 
at a great variety of specific tasks. 

Elsewhere (Fleishman, 1964; Gagné & 
Fleishman, 1959) we have elaborated our 
analysis of the development of basic abilities. 
This included a discussion of their physiolog- 
ical bases, the role of learning, environmental 
and cultural factors, and evidence on the rate 
of ability development during the life span. 
With this much conceptualization in mind, we 
can say that in much of our previous work 
one objective has been to describe certain 
skills in terms of these more general ability 
requirements. 

The original impetus for this program was 
a very applied problem. While I was with the 
Air Force Personnel and Training Research 
Center, one of our missions was to build 
better psychomotor tests for the prediction 
of pilot success. The wartime Air Force pro- 
gram had been highly successful in developing 
such tests. For example, the Complex Co- 
ordination Test had consistent validity for 
pilots. This seems not surprising, since the 
test seemed to be a “job sample" of aspects 
of the pilot's job. The pilot does manipulate 
stick and rudder controls. But there were 
many tests which had substantial validity 
but did not at all *resemble" the pilot's job. 
Cases in point are the Rotary Pursuit and 
Two Hand Coordination Tests. And there 
were other tests which seemed to resemble 
aspects of the pilot's job but had no validity. 
So it seemed to me that the first step was to 
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discover the sources of validity in these tests. 
What ability factors were there in common 
to psychomotor tests which were common 
to pilot performance (see, e.g., Fleishman, 
1953, 1956; Fleishman & Hempel, 1956)? - 

Perhaps a not too extreme statement is 
that most of the categorization of human 
skills, which is empirically based, comes 
from correlational and factor-analysis stud- 
ies. Many of these studies in the literature are 
ill designed or not designed at all. This does 
not rule out the fact that properly designed, 
systematic, programmatic, correlational re- 
search can yield highly useful data about gen- 
eral skill dimensions. We can think of such 
categories as representing empirically derived 
patterns of response consistencies to task 
requirements varied in systematic ways. In a 
sense this approach describes tasks in terms 
of the common abilities required to perform 
them. As an example, let us take the term 
“tracking,” a frequent behavioral category em- 
ployed by laboratory and systems psycholo- 
gists alike. But we can all think of a wide 
variety of different tasks in which some kinds 
of tracking are involved. Can we assume that 
the behavioral category of tracking is useful 
in helping us generalize results from one such 
situation to another? 15 there а general track- 
ing ability? Are individuals who are good 
at compensatory tracking also the ones who 
are good at pursuit tracking? Do people who 
are good at positional tracking also do well 
with velocity or acceleration controls? What 
happens to the correlations between perform- 
ances as a function of such variations? It is 


to these kinds of questions that our program 
was directed, 


Some Previous Research 


In subsequent years we have conducted a 
whole series of interlocking, experimental, 
factor-analytic studies, attempting to isolate 
and identify the common variance in a wide 
range of psychomotor performances. Essen- 
tially this is laboratory research in which 
tasks are specifically designed or selected to 
test certain hypotheses about the organization 
of abilities in a certain range of tasks (see, 
eg., Fleishman, 1954). Subsequent studies 
tend to introduce task variations aimed at 
sharpening or limiting our ability-factor de- 


finitions. The purpose is to define the fewest 
independent ability categories which might 
be most useful and meaningful in describing 
performance in the widest variety of tasks. 

Our studies generally start with some 
gross area of human performance. Thus, we 
have conducted studies of fine manipulative 
performances (Fleishman & Ellison, d 
Fleishman & Hempel, 1954a), gross рч 
proficiency (Fleishman, 1963, 1964; Hempe 
& Fleishman, 1955), positioning movements 
and static reactions (Fleishman, 1958a), and 
movement reactions (Fleishman, 19580; 
Fleishman & Hempel, 1956). 

Thus far, we have investigated more Шап 
200 different tasks administered to thousands 
of subjects (Ss) in a series of interlocking 
studies. From the patterns of correlations 
obtained, we have been able to account for 
performance on this wide range of tasks ш 
terms of a relatively small number of abilities: 
In subsequent studies our definitions of these 
abilities and their distinctions from one am 
other are becoming more clearly delineated. 
Furthermore, it is now possible to specify 
the tasks which should provide the best 
measure of each of the abilities identified. 

There are about 11 psychomotor factors 
and 9 factors in the area of physical pro- 
ficiency which consistently appear to account 
for the common variance in such tasks. Their 
labels are Control Precision, Multilimb Co- 
ordination, Response Orientation, Reaction 
Time, Speed of Arm Movement, Rate > 
trol, Manual Dexterity, Arm-Hand rt 
ness, Wrist-Finger Speed, Aiming. In E 
Physical proficiency area, a program wee 
recently completed and described in boo 
form (Fleishman, 1964); the factors havé 
names like Extent Flexibility, Dynamic 
Flexibility, Static Strength, Dynamic Strength, 
Explosive Strength, Trunk Strength, Gros 
Body Coordination, Gross Body Equilibriu™ 
and Stamina. 

Of course, there are detailed descriptions 
of the operations involved in each category 
(see Fleishman, 1960b, 1962, 1964, 1966; 
1967); some of them are more general ip 
Scope than others. But it is important {0 
know, for example, that it is not useful t? 
talk about strength as a dimension, but that 
in terms of what tasks the same people са? 
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do well, it is more useful to talk in terms of 
at least four general strength categories 
which may be differentially involved in a 
variety of physical tasks. 

Perhaps it might be useful to provide some 
examples of how one examines the generality 
of an ability category and how one defines its 
limits. The definition of the Rate Control 
factor may provide an example. In early 
Studies it was found that this factor was 
Common to compensatory as well as following 
Pursuit tasks. To test its generality, tasks 
Were developed to emphasize rate control, 
which were not conventional tracking tasks 
(eg, controlling a ball rolling through a 
Series of alleyways). The factor was found 
to extend to such tasks. Later studies at- 
tempted to discover if emphasis on this 


ROTATION 


О° DISPLAY 


90° DISPLAY ROTATION 


ability is in judging the rate of the stimulus 
as distinguished from ability to respond at 
the appropriate rate. A task was developed 
involving only button pressing in response to 
judgments of moving stimuli. Performance 
on this task did zo£ correlate with other rate 
control tasks. Finally, several motion picture 
tasks were adapted in which S was required 
to extrapolate the course of a plane moving 
across a screen. The only response required 
was on an IBM answer sheet. These tasks 
did not relate to the core of tasks previously 
found to measure “rate control.” Thus, our 
definition of this ability was expanded to 
include measures beyond pursuit tasks, but 
restricted to tasks requiring the timing of a 
muscular adjustment to the stimulus change. 
A similar history can be sketched for each 


225° DISPLAY ROTATION 


Fro, 1, The Response Orientation Device, showing four conditions of display rotation (drawing 
has omitted certain details not relevant). (After Fleishman, 1957.) 
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ability variable identified. Thus, we know 
that S must have a feedback indicator of how 
well he is coordinating before the Multilimb 
Coordination factor is measured; we know 
that by complicating a simple reaction-time 
apparatus, by providing additional choice 
reactions, we measure a separate factor (Re- 
sponse Orientation), but that varying the 
stimulus modality in a simple reaction-time 
device does not result in measurement of a 
separate factor. 

Some later studies using experimental-cor- 
relational approaches provide encouraging 
results which indicate that it is possible to 
build up a body of principles through sys- 
tematic studies of ability-task interaction in 
the laboratory. The approach is to develop 
tasks which can be varied along specified 
physical dimensions, to administer these 
tasks, systematically varied along these di- 
mensions, to groups of Ss who also receive 
a series of "reference" tasks, known to sample 
certain more generalized abilities (еш, 
"Spatial Orientation,” "Control Precision," 
certain “Cognitive Abilities” Я 
between these reference tasks an 
variations of the criterion task 
ability requirements 


Correlations 
d scores on 
Specify the 
(and changes in these 
requirements) as a function of task varia- 


tions. Thus far we have studied tasks 
varied along the following dimensions: de- 
gree of rotation of display panels relative to 
response panels; the Predictability or non- 
Predictability of target course or response 


TABLE 1 


GS OF RESPONSE MEASURES FOR 
NDITIONS OF DISPLAY ROTATION 


FACTOR Loaprx 
DIFFERENT Co 


Factor 

Display 
rotation Perceptual Response Spatial 

speed orientation orientation 
0° (1) 47 = "x 
45° (A) 40 = 34 
90° (>) = = 24 
135° (му — 37 48 
180° (1) — 40 40 
225° (7) = 20 ae 
270° (—) E = 30 
315” (Ñ) 36 ig = 


Note.—Loadings below 


430 omitted, Adapted from E, A. 
Fleishman, 1957. 
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requirements; the extent to which the task 
allows $ to assess the degree of coordination 
of multiple limb responses; the degree of 
stimulus-response compatibility in display- 
control relationships; whether there is a con- 
stant “set” or changing “set” from one 
stimulus presentation to the next; whether 
or not certain kinds of additional response 
requirements are imposed in a visual el 
crimination reaction task; whether or no 
certain kinds of feedback are provided. d 
fully, once such principles are established, ! 
should be possible to look at new tasks, 
operational or otherwise, and specify the 
ability requirements, P 
Perhaps I can illustrate with one study pi 
which we were able to show sara 
changes in the abilities required to p F 
task as the display-control relations in p 
task were systematically varied. The 5 е 
required to press a button within a circula 
arrangement of buttons on a response pane? 
in response to particular lights which “A 
peared in a circular arrangement of lig fis 
on the display panel (see Figure 1). Thi 
display panel was rotated from 0° to 45°, 90^: 
135°, 180°, 225°, and 270°. The same 
performed under these task conditions wi 
also performed on a series of spatial, gei 
ceptual and psychomotor reference tas A 
The results showed systematic changes (е 
factors sampled by the criterion taske on y 
function of degree of rotation of the disp к 
panel. Progressive rotation shifted the ue 
quirements from “Perceptual Speed" to tW 
other factors “Response Orientation" ай 
"Spatial Orientation? (see Table 1). Thus 
individual differences along known cima | 
are used to explore the relations between tas id 
and the characteristics of people who cou 
perform the tasks most effectively, Of course 
these are problems faced every day by p 
sonnel, training, engineering, and syste 
psychologists, : 
The results of other studies (e.g., the on" 
in which we varied stimulus-response com 
patibility) showed that certain variation 
did make a difference but others did no" 
Such studies indicate that it should be po 
Sible to develop principles relating task d 
mensions to ability requirements, usi”? 
laboratory experimental-correlational studie" 
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Some Applications of the Taxonomy 


I would like to mention a few areas in 
which the framework developed has proven 
useful in accounting for phenomena under 
investigation. For a number of years, I have 
been interested in the relations between refer- 
ence ability measures, developed around our 
perceptual-motor taxonomy, and a variety of 
learning phenomena (see, e.g., Fleishman, 
1957a, 1957b, 1960a; Fleishman & Hempel, 
1954b, 1955; Fleishman & Rich, 1963). Our 
results have allowed us to show the differential 
role of these abilities at different stages of 
learning more complex tasks. These studies 
have as an additional goal the specification 
of abilities predictive of advanced levels of 
learning. The laboratory findings have been 
shown to hold with simulations of complex 
operational tasks such as piloting an air- 
intercept mission (Parker & Fleishman, 
1960) and have been extended to real-life 
training situations involving skills other than 
perceptual-motor skills ( Fleishman & Fruchter, 
1960). We have recently summarized these 
findings elsewhere (Fleishman, 1966, 1967). 

We have also used this paradigm to study 
part-whole task relationships (Fleishman, 
1965; Fleishman & Fruchter, 1965), the 
prediction of associative interferences Бе- 
tween two tasks, and the Prediction of 
retention phenomena (Fleishman & Parker, 
1962). 

These categories have also proven useful in 
accounting for the interrelations among com- 
-wing (Fleish- 
1960) and helicopter 
la, & Fleishman, 1965), 
proficiencies (Herbert, 
^W у been able to facilitate 


of these abilities at 
ing this complex tas 
1961). 

Are these categories useful as a means of 
task standardization and for generalizing re- 
search results to new tasks? We do not have 
any ready answer, but we are working on the 
problem. Let me at least mention a few 
studies in which tasks, representing these 
task dimensions, have been used. These 


studies have included research on the effects 
of stress—fear (Gorham & Orr, 1957), diet 
(Brozek, Fleishman, Harris, Lassman, 1 & 
Vidal, 1955), and drugs (Baker, Elkin, Van 
Cott, & Fleishman, 1966; Elkin, oe: 
Van Cott, Horowitz, & Freedle, 1965), cm 
an ongoing study on the effects of hig 
altitude (anoxia). For use in the space 
environment, in collaboration with James 
Parker, a console has been developed to 
measure in a compact unit 15 different "à 
tors for possible application in the manne 
orbital laboratory program (Parker, Reilly, 
Dillon, Andrews, & Fleishman, 1965). But it 
is in our drug work that we hope to make 
an approach to checking on the ааа 
tions possible from standardized batteries 0 
"basic ability? measures. We are observing 
the effects of a variety of drugs and dosages 
on measures of a variety of reference pu 
ures. These measures sample the perceptual, 
motor, sensory, and cognitive areas. We eh 
Setting differential effects, that is, T 
abilities within each area are more affecte 
than others. Figure 2 gives a few illustrations 
of these events. The question is whether е 
get parallel results with other tasks ded 
resenting the same factors. A further m 
includes the development of complex tas à 
and the testing of these drug effects on suc 
tasks. The question is whether our laboratory 
results, using component ability measures 
could have predicted the drug effects on th 
complex tasks, T 
Finally, let me say that I am not at à 
sure about the ultimate utility of this kind 9 
taxonomy. It may well be that the kind 0 
taxonomy most useful to one set of applie 
problems (eg, training) may be differen 
from the one useful for another problem (e£ 
Selection, system design). But I am em 
couraged that the framework thus far d€ 
veloped has been useful in integrating some 
previously disparate data, that it has helpe 
Simplify some problems, and that it has le 
to some standardization of laboratory task$ 
used in a variety of research areas, 
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A STUDY OF REMOTE INDUSTRIAL TRAINING VIA 
COMPUTER-ASSISTED INSTRUCTION 


Н. A. SCHWARTZ лхр Н. S. LONG? 
IBM Corporation, Poughkeepsie 


During the latter half of 1965, several field engineers received their required 


training in new 


computer technology through remote computer-assisted in- 


struction (CAI). Students at terminals located in 4 major cities communicated, 


through Tele-processing facilities, with a 


computer system located centrally. 


Students’ examination scores, course completion times, and attitudes were 
compared with those of other students who received the material through self- 


study texts in use at the time. 
examination, 
study students. Attitude scores were 


for the former. When compared to a 
however, the self-study students 
the CAI students. CAI students’ 


CAI students scored lower on 1 part of the 
but completed the course in considerably less time than the self- 


somewhat equivocal. Students who had 
been exposed to both CAI and self-study texts indicated a strong preference 


“regular classroom” type of presentation, 
rated their method slightly higher than did 
attitudes appear to be related to the avail- 


ability of assistance when course material problems are encountered. Additional 


findings from locally trained CAI stu 


interpretation. 


For several years research on the use of 
computers in education has been underway. 
In general, this research has been concerned 
with academic courses, environments, and 
students, at various scholastic levels. 

Somewhat more recently, and paralleling 
this activity, efforts have been aimed at the 
application of computer-assisted instruction 
(CAT) to the problems of industrial training. 
Initial endeavors along this line were per- 
formed “in-house”—at a location that housed 
both the system and the student terminals. 
Thus, these students studied with the close 
Supervision and assistance of the course au- 
thors and research personnel associated with 
the project. 

In a later study (Schwartz & Haskell, 
1966) the computer system was located in 
Опе building and the students in another. 

hus, supervision and assistance were relaxed 
Slightly, Та cooperation with a manufacturing 
— 

1 This study could not have been carried out with- 
Out the major contributions made by R. K. Valley, 
Who authored the CAI course employed in the study; 

Ayne Wengert, who provided invaluable additions 
and modifications to the computer-control program 
and dealt with program problems as they arose; and 

€eland R, O'Neal, who authored some of the earliest 

course material and who, along with R. K. 

Шу › supervised the general operation of the 
entire System. 
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dents are presented in support of this 


facility of a major electronics corporation, 
newly hired technicians received their re- 
quired training in data-processing funda- 
mentals through either CAI or the pro- 
grammed-instruction (PI) text operationally 
in use at that time. 

In a more recent phase of research, con- 
ducted during the latter half of 1965, student 
terminals were located even more remotely 
and in a number of widely dispersed locations. 
An extensive amount of subject matter was 
taught to field engineers in an operational, 
work-oriented environment. For comparative 
purposes, the students received their instruc- 
tion through either the self-study texts in use 
at that time or through CAI. The remainder 
of this paper deals with the conduct and re- 
sults of that study. 


METHOD 


Materials. The material employed in the study 
consisted of an introductory (preschool) course 
dealing with a new generation of computers. Satis- 
factory completion of this course was a pre- 
requisite for further training at a distantly located 
education center. The operational form of this 
course consisted of a series of self-study textbooks 
written in a general programmed-text format. 
The topics covered included: 


(a) Numbering Systems 
(b) Programming Systems 
(c) IBM System/360 Programming 
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Fic. 1, Computer-assisted instruction system. 


(d) Input/Output Programming 

(e) SLT (Solid Logic Technology) Component 
Circuits and Packaging 

(f) Core Storage 


The CAI version of the c 
accomplish the same objecti 
version. 


CAI system. The CAI System employed in the 
study was an IBM 1440-1448 System, configured as 
shown in Figure 1. Although a number of student/ 
author terminals are diagrammed in Figure 1, only 
four of these (one each in Los Angeles, San 
Francisco, Washington, D. C. and Philadelphia) 
were formally part of the study. The student ter- 
minals were of two types: one lype consisted of a 


ourse was designed to 
lves as the self-study 


typewriter-like device on which the student could 
receive typewritten messages from the computer 
and could type his Own messages to the computer. 
Visual material Portions of the course text were 
contained in a Separate book to which the student 
Was referred, when necessary, by a typewritten 
message. The other type of terminal consisted of 
both the typewriter-like device and an associated 
Stored-image visual display device. No book was 
necessary with the display device. The required 
visual and textual material was presented to the 
Student under the control of the central computer: 
With both display and nondisplay terminals 
the student Tesponded to the system only via the 
terminal keyboard. For a more complete descrip- 
tion of the CAT system, including examples of 


COMPUTER-ASSISTED INSTRUCTION 


Student and author versions of course material, 
see Schwartz and Long (1966). 

Subjects. During the predesignated pilot-study 
Period of June 2-December 31, 1965, 40 field 
engineers participated in the study as students. At 
that time, each student was scheduled to participate 
in future advanced training at an education center. 
Students’ background included experience with 
punch-card equipment, small and/or large computer 
Systems. The distribution of students according to 
Study location and method oí instruction is shown 
in Table 1, 


PROCEDURE 


In keeping with its original intent—that of deter- 
mining the feasibility of CAI as a means of ac- 
Complishing the required training without removing 
the student from his work location—the study was 
Conducted under generally normal working condi- 
tions, In each location a monitor was designated to 
be „responsible for operation of the terminal, the 
registration of students, maintenance of records, col- 
lection of data, and the establishment of study 
schedules, 

As part of their normal educational sequence, 
Students were assigned by their managers to com- 
Plete the preschool course. Although a number of 
Students might be taking the course at any given 
time, the original assignments were generally made 
Оп a one-student-at-a-time basis. When the as- 
Signment to the course had been made, the student 
Was then further assigned to either the CAI or selí- 
Study technique of instruction by the study monitor. 
n the assignment an attempt was made to fully 
utilize the CAI terminal in each location. Thus 
for each student an attempt was first made to assign 
tm to CAI. Where the terminal was not available 
At the time required by the student's schedule, he 
Was assigned to the self-study group. 

CAI students were ordinarily scheduled for study 
Sessions of 2-hours duration, $ days per week. In 
Some cases, however, impending dates for educa- 
tion-center classes forced more extensive study 
Periods, 

Self-study students were less formally scheduled 
and supervised but were encouraged to spend at 
cast 2 hours of each working day in study. 


DATA 


NL types of data were 
а These were measures of 
udy time, and (c) attitude. 
‚ Achievement. The achievement measures 
Sisted of the scores attained on Parts II and п 
Sn independently prepared, four-part final ex- 
amination (Parts I and IV were not related to the 
Study course material). The examination was 
Multiple-choice in format and was administered to 
© students by the monitor. Part II consisted of 
S questions and Part III of 10. Each part was 
cored independently on a 100-point scale. 
Se Monitors maintained continuous records of 
n-job study time for the CAI students. Any off-job 


collected during the 
(a) achievement, (b) 


con- 


TABLE 1 
DISTRIBUTION OF STUDENTS BY LOCATION 


Number of students 
Location 


Self-study CAI 


Los Angeles 

Philadelphia 

San Francisco 

Washington, D. C. 
Total 


DAOnwn 
ооо н 


to 


time spent in study (e.g. reading reference manuals) 
was reported on a questionnaire completed by the 
CAI students. The self-study students were supplied 
with a special form, on which they made daily 
recordings of their on-job and off-job study time, 
and which was returned to the monitor. 

Attitude. At the end oí the course, but prior to 
the final examination, each student completed an 
attitude questionnaire. This questionnaire solicited 
his comments on both the course material and the 
instructional method and also required him to com- 
pare his instructional method with other techniques. 


HYPOTHESES 


Based upon the previous research in CAI, the 
following hypotheses were advanced: 

Hypothesis 1. Examination scores should be ap- 
proximately equal for the two techniques. This 
would be expected on the basis that both the CAI 
and the self-study presentations were written to 
accomplish the same objectives. On the other hand, 
in view of the uncertainty inherent in examination 
scores of this type, it was stated that even if 
statistically significant difference should occur, no 
meaningful conclusions could be drawn unless such 
differences were quite large. 

Hypothesis 2. The CAI students should complete 
the course in less time than the self-study students. 
This was based on the superior capability of CAI, 
through pretesting and system-controlled branching, 
to adapt to individual differences in ability and 
experience. 

Hypothesis 3. The attitude of the CAI students 
toward CAI should be superior to the attitude of 
the self-study students toward self-study. This 
hypothesis was based on the ability of CAI to 
present a more individualized sequence of material 
and to provide hints when the student answers 
incorrectly. 


RESULTS AND DISCUSSION 


Achievement. 'The results shown in Table 2 
tend to refute the original hypothesis that the 
two groups should score approximately the 
same on the examination, Nonparametric 
statistical tests, applied to these data, in- 


— -1-] e. 
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TABLE 2 
MEAN SCORES ON COMPREHENSIVE EXAMINATION 


Exam section 


Group 
п | ш 
79.0 87.1 
САТ 79 915 


Self-study 87.4 


dicate that the self-study group scored sig- 
nificantly higher on Section II of the ex- 
amination (Mann-Whitney U = 75, = 2.42, 
p (two-tailed) <.02). The same pattern ap- 
pears on Examination Section III, but the dif- 
ference does not attain statistical significance 
(р (two-tailed) > .05). 

When the hypotheses of the study were set 
forth, it was noted that no differences were 
expected but that even if differences were to 
occur, the uncertainty involved in the inter- 
pretation of these examination scores would 
preclude the drawing of any firm conclusions 
unless the differences were quite large. In the 
case of Examination Section П, the actual 
difference obtained (8.4 points) is equivalent 
to approximately two multiple-choice ques- 
tions on the test. In Section III, the difference 
(5.8 points) amounts to less than one mul- 
tiple-choice question. Thus, while the obtained 
differences reached or tended toward statis- 
tical significance, these differences, presently, 
are of unknown practical significance, 


STUDY Time REQUIRED 

Table 3 shows the m 

off-job, and total h 
the course. 

It may be seen that the two groups were 

approximately the same in terms of on-job 

time (62.5 and 64.3), However, the self-study 


ean number of on-job, 
ours required to complete 


TABLE 3 
Mean Hours REQUIRED to COMPLETE Course 


М hours to completion 


Group 
On job Off job Total 
CAI 62.5 2.9 65.4 
Self-study 64.3 12.3 76.6 


students required significantly more ofí-job 
time (Mann-Whitney U = 36.5, 2 = 9.9, $ 
(two-tailed) « .0006). This difference is re- 
flected in the total time required to com- 
plete the course, which shows a savings of 
11.2 hours, or approximately 15% in favor 
of the CAI group (Mann-Whitney О = 
101.50, z = 2.12, p (two-tailed) = .03). These 
results are consistent with the original hy- 
pothesis that the CAI group should require 
less study time than the self-study group. 

Attitude. In one portion of the attitude 
questionnaire, the students were asked to 
compare their method of instruction with 
others with which they were familiar. They 
did so by checking the most appropriate 
of five statements following each of the four 
questionnaire items. According to the state- 
ments they checked, their responses were 
assigned integer scale values ranging from 1 
(indicating negative feelings toward their 
method) to 5 (indicating positive feelings 
toward their method). These results appear 
in Table 4. 

It may be seen in Table 4 that in the com- 
parisons with the regular classroom, the self- 
study method appeared to be rated slightly 
higher than the CAI method on each of the 
four questionnaire items. Only for Item III, 
however, was the difference between the two 
groups (3.3 versus 2.2) statistically significant 
(Median test, y? = 5.75, df — 1, p (two 
tailed) < .02). In addition, note that in com- 
parison with the regular classroom, the mean 
Scale values for CAI were less than 3.0 p 
each of the four questionnaire items. Thus, 1 
appears that the CAI students had ge 
what negative feelings toward that method 0 
instruction. This finding appears related to 
others to be discussed later in this report. 

Inasmuch as the self-study students ha 
not been exposed to CAI, no direct com- 
Parison of these two techniques could be made 
by them. On the other hand, the CAT students 
had experience with both techniques an 
consequently were able to rate one against 
the other. These results appear in the right- 
hand column of Table 4. Another nonpara- 
metric statistic (Kolmogorov-Smirnov one- 
Sample test) was employed to determine 
Whether these figures differ from what would 
be expected merely on the basis of “chance. 
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TABLE 4 
MEAN SCALE VALUES ON ATTITUDE QUESTIONNAIRE ITEMS 
Self-study CAI compared 
Questionnaire item compared with with regular CAT compared 
regular classroom classroom with self-study 
I. In your opinion, how well were you taught the 2.8 2.1 3.8 
material covered? 
П. In your opinion, how difficult is it to learn 2.9 2.6 3.5 
through (CAI) (Self-Study)? 
III. Which method of teaching do you like best? 3.3 22 42 
IV. If you had your choice, which method would 3.0 2.3 4.4 
you use in future courses? 


of inNote.—Scale values range from 1 to 5. A 
с struction. A value of 5 indicates positive 
Ween their own and the comparison methods. 


The results indicated that the responses to 
all but Questionnaire Item II were statis- 
tically significant (р < .05). Thus, it appears 
that students familiar with both techniques 
Consider CAI superior to self-study. 

Since this study represented the students’ 
first use of this medium of instruction, it is, 
Of course, possible that these attitudinal find- 
ings merely reflect the “novelty” of CAI, 
rather than any intrinsic instructional or 
Motivational attributes it may possess. In 
View of the course length (65.4 hours), how- 
ever, it is likely that any initial novelty effect 
Would have dissipated prior to the com- 
Pletion of the material. 

In the attitude questionnaire, the students 
also received a list of various instructional 
techniques and were requested to indicate the 
Proportion of each technique that they would 
like to see employed in future theory-type 
Courses they might take. The results of this 
Survey are shown in Table 5. It may be seen 
that both the CAI and self-study groups m- 
dicated a clear-cut preference for their re- 
Spective techniques to constitute the primary 


Instructiona] method in future courses. The 


ifference between these preferences (51.9 

Versus 62.7) was not, however, statistically 
Significant. 
. The pattern apparent in Table 4 reappears 
in Table 5, In terms of the proportion pre- 
ferred in future courses, the self-study tech- 
Niques were rated as quite desirable by the 
Self-study students (62.7%), but as rather 
Unattractive in the eyes of the CAI students 

(4.8%), 


value of 1 indicates that students have negative feelings toward their own method 
feelings toward their own method of instruction. A value of 3 indicates indifference 


It was previously noted that, in general, 
the CAI students tended to rate CAI some- 
what lower than regular classroom instruction 
(see Table 4). Table 5, however, shows that 
these same students indicated approximately 
a 2:1 preference for CAI over regular class- 
room in future courses (51.9% versus 25.0%). 
One student, for example, gave CAI the 
lowest possible rating when comparing it with 
regular classroom. Yet he indicated that he 
would prefer to see CAI employed 90% of 
the time in future courses. Attitude-question- 
naire comments and personal interviews con- 
ducted with CAI students provide a plausible 
explanation for this apparent paradox. By 
far, the students’ major complaint was the 
unavailability of an instructor when they re- 


TABLE 5 


PREFERENCE FOR COMPOSITION OF INSTRUCTIONAL 
‘TECHNIQUE TO BE EMPLOYED IN 
FUTURE COURSES 


Self- 
Method CAL study 
group 
group 
Lecture by live instructor 250 | 180 


Lecture presented by film or television | 2.9 6.0 
Self-study material (programmed 


texts, etc.) 
Individual instructor to work with 5.5 2:1 
you 
Discussion class (guided by instructor) | 10.0 10.7 
Computer-Assisted Instruction 51.9 | =* 


а Since the self-study students had no exposure to CAI, this 
alternative was not presented on their questionnaires. » 

* Significant difference between CAI and self-study (Median 
test, x? = 18.9, df = 1, p < .0005, two-tailed). 
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quired further explanation on some particular 
point in the course. The ability to type “help” 
and receive the correct answer (as is per- 
mitted by the system), but without any ac- 
companying explanation, was unsatisfactory 
to them. In this respect, the text may even 
provide an advantage, since a student can 
more quickly skim the previously covered 
material and possibly find the solution to his 
problem. This may also account for the 
suggestion (the differences were not statis- 
tically significant) in Table 5 that the CAI 
students preferred more live lecture (2596 
versus 18%) and individual instruction 
(5.5% versus 2.796) than did the self-study 
group. 

Thus, it seems from their responses to the 
attitude questionnaire that the CAI students 
were indicating their desire for an instructor 
as something similar to a “fire escape” —they 
do not need him frequently or for long 
periods, but when they do, they feel it ex- 
tremely important that he be immediately 
available. This interpretation is supported by 
data collected on five comparable students 
who completed the same course via CAI, but 
at the location of the central computer. 
(These data were not included in the previ- 
ously presented results because these students 
were not formally a part of the study.) 
Under these conditions, immediate and expert 
help, in the person of the course authors, 


was continuously available. Because of the 
small sample size and the obvious possibility 
that some bias due to the transmitted en- 
thusiasm of the CAI system personnel may 
have taken place, no statistical analysis of 
these data was attempted. However, in view 
of the interpretation previously advanced, it 
is interesting to note that these centrally 
located CAI students performed better than 
the remotely located CAI students in terms of 
both examination scores and study time. 

When compared to both regular classroom 
and self-study, in terms of attitude, they also 
tated CAI considerably апа consistently 
higher than did the remotely located CAI 
students. 

Finally, and presumably because of the 
availability of assistance in their study loca- 
tion, the centrally located CAI students in- 
dicated a preference for more CAI and re- 
quested less individual tutorship and live 
lecture than did their counterparts in the 


more remote and less closely monitored CAI 
environments. 
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HEREDITARY INFLUENCES ON VOCATIONAL РКЕЕ- 
ERENCES AS SHOWN BY SCORES OF TWINS ON 
THE MINNESOTA VOCATIONAL INTEREST 
INVENTORY * 


STEVEN С. VANDENBERG axp RICHARD E. STAFFORD 


University of Louisville School of Medicine 


The Minnesota Vocational Interest Inventory (MVII) scores of 53 íraternal 
pairs of twins showed greater within-pair variances than did the scores of 71 
identical pairs. For 9 of the scores and 4 of the area keys the F test showed 
a statistically significant increase in within-pair variance for the fraternal twins. 
This is interpreted as evidence for a hereditary component in interests in 


occupations requiring no scientific ability. 
probably through personality variables. 


The consensus of investigators in the area 
of Vocational preferences seems to be that 
Interests in occupations develop gradually as 
the child learns about himself and the world 
around him and that such interests only 
begin to take definite shape late in adolescence 
(Darley & Haganah, 1955; Roe, 1956; Super, 
1957). However, the long-neglected finding of 
Carter (1932) that identical twins show 
Breater similarity in occupational choices than 
do fraternal twins (as measured by the SVIB) 
Would suggest that vocational preference is 
not entirely determined by environment. 
Carter’s finding was later confirmed in replica- 
Чоп by Vandenberg and Kelly (1964). _ 

The idea that genes may help determine 
the Occupation one prefers may seem rather 
Startling at first thought. It is highly prob- 
able, however, that the aptitudes and pêr- 
Sonality traits disposing one to a particular 
Vocational preference are under genetic ш- 

uence, and thus the idea of hereditary ìn- 
fluences on vocational preference becomes 
More acceptable. 

In the studies of twins by Carter (1932) 


* The research reported here was supported by 
Grant HD 00843 and K3-MH-18382 of the National 
nstitutes of Health. The serological tests on which 
i Zygocity determination was based were per- 
O9rmed by Jane Swanson of the Minneapolis War 

emoria] Blood Bank. The tests were scored by 
on id C. Campbell and the calculations performed 
th the IBM 7090 at the University of Rochester 

Tough the help of К. E. Clark and Anne Naymik. 
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The hereditary influence operates 


and Vandenberg and Kelly (1964) it was 
found that hereditary influence was most 
marked in the group of science-related oc- 
cupations. To explore whether these hered- 
itary influences could also be detected in 
vocational interests requiring a minimum of 
scientific ability, the Minnesota Vocational 
Interest Inventory (MVII), described by 
Clark (1961), was administered to 53 fra- 
ternal and 71 identical pairs of twins. The 
MVII measures interest in 20 nonprofes- 
sional occupations such as baker, painter, or 
truck driver. In addition, interests in 9 
general areas are measured by homogeneous 
keys which group occupations requiring 
similar skills or interests such as office work, 
outdoor work, etc. 

Several methods have been proposed for 
the assessment of the importance of hereditary 
components in a variable, such as a herit- 
ability index Н (Holzinger, 1929), chi-square 
(Thurstone, Thurstone, & Strandskov, 1953), 
and analysis of variance (Dahlberg, 1926). 

The latter method has been used in this 
study, following Clark (1956) and Kemp- 
thorne and Osborne (1961). The variance of 
the fraternal (DZ) twins is partitioned in 
the between-pairs and  within-pairs com- 
ponents; similarly for the identical (MZ) 
twins. 

First, one may wish to check that the be- 
tween-pair variance exceeds the within-pair 
variance, that is, that the intraclass correla- 
tions are positive. Next, one obtains the 
ratio between the fraternal within-pair vari- 
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TABLE 1 


COMPARISON OF FRATERNAL AND IDENTICAL WITHIN- 
PAIR VARIANCES ON 30 SCORES ON THE 
MINNESOTA VOCATIONAL INTEREST 


INvENTORY 
Girls Boys | All cases 
Score 34 DZ— | 19 DZ— | 53 DZ— 
40 MZ | 29 MZ | 69 MZ 
Baker 1.169 2.680** | 1.796* 
Carpenter 1.379 1.951* 1.583* 
Electrician 1.415 1.395 1.331 
Food service man 1.125 1.519 1.266 
Hospital attendant 2.340** | 2458** | 2.439** 
Industrial education OAL 1.031 .978 
їеасһег 
IBM operator 1.980 | 2.605** | 2247** 
Milk wagon driver 2.204* 1.352 1.624* 
Machinist 1.251 1.455 1.313 
Painter 1.281 .665 -968 
Plasterer 1.127 1.618 1.310 
Plumber 940 1.004 931 
Pressman 1.426 1.355 1.425 
Printer 1.167 2.161* 1.513 
Retail sales clerk 3.794** | 1.994% 2287** 
Radio and TV repair-| 1,045 1.852 1.368 
man 
Shipping and stock .849 1.418 1.071 
cler] 
Sheet metal worker 1.402 1.110 1.235 
Truck driver 1.306 2.737** | 1.820** 
Truck mechanic 1.646 1.585 1.531* 
Warehouseman 1.237 3.310** | 1.935** 
Hi—Machine repairs 3.826** | 2.498* 2.503** 
H;—Medical hospital | 1,567 991 1.353 
service 
Ha—Office work 1.714* 787 1.396 
accounting 
H,4— Radio, etc. 1.611 1.231 1.293 
Hs—Food prepara- 1.107 1.188 1.139 
tion and menu 
planning 
He—Carpentry and | 1.124 924 | 1.003 
furniture making 
Hz—Verbal activity 1.007 .659 .813 
aesthetic 
Hs—Clean hands 1.412 .808 1.111 
Hs—Athletics out- 166 1.090 .898 
door masculine 
* 
PX 


ance to the identical within-pair variance 


c*wDZ 
c*wMZ 


The identical within-pair variance is solely 
due to environmental influences, because 


identical twins, who arise from one fertilized 


PF 


egg, have the same genes, except for a e 
somatic mutation here or there. The fraterna 
within-pair variance is due to similar environ- 
mental influences plus differences in genes, 
because fraternal twins result from two 
fertilized eggs. They will have, on the average; 
only 50% the same genes, just like other 
pairs of siblings not born at the same time. 
This ratio may be thought of roughly as be- 
tween variance due to heredity plus environ- 
ment and variance due to heredity alone. The 
statistical significance of the departure from 
1.00 is evaluated as an F ratio. . 

Table 1 shows that significant F ratios 
were found more frequently for boys than for 
girls. With boys and girls combined, signifi 
cant F ratios were found for nine occupationa 
interests and four homogeneous vocationa 
areas. Significant beyond the .01 level ч 
probability were: baker, hospital attendant, 
IBM operator, retail sales clerk, truck dewey 
and warehouseman. Significant beyond E. 
:05 level of probability were carpenter, mi 
wagon driver, and truck mechanic. 

The Е ratios for the homogeneous а" 
scales reached the .01 level of significance fo Я 
Occupations involving machine repairs (SC ў 
Ні), and the .05 level of significance for 0 
cupations involving Beneral office work (B 
and for those involving repair and operatio 
of electrical and electronic devices (Scale Ha) 


Conclusion 


The results seem to indicate that hereditary 
influences on vocational interests are wl 
necessarily limited to high-level abilities 5% j 
aS those required for scientific and profe" 
sional Occupations, but range over the ent 


Occupational spectrum, It is most likely Шә 


the hereditary components influence 006 


* . . 2 1 n 
aptitudes and personality traits, which in tu” 
influence vocational preferences, 
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JOB SATISFACTION AND THE DESIRE 
FOR CHANGE? 
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Questionnaire data on office em 


tion with existing amounts of 


change are used in testing the h 
changes is governed not only by 
him of existing and potential job с 
very process of change. The hypo 
sion analyses of aggre 


The ability of rank-and-file employees and 
lower levels of management to delay or impede 
technical and organizational change has long 
been recognized by social scientists and by the 
managerial groups in which forces for change 
often originate. The resultant concept and 
phenomenon of resistance to change have 
been the focus of many articles in managerial 
literature (Schleh, 1960; Selekman, 1945; 
Zander, 1950) and of an increasing number 
of empirical and theoretical research studies 
(Coch & French, 1948; French, Israel, & 
Aas, 1960; French, Ross, Kirby, Nelson, & 
Smyth, 1958; Ginzberg & Reilley, 1957; 
Lawrence, 1954, 1958; Lippitt, Watson, & 
Westley, 1958; McMurray, 1947 ; Miller, 
1960; Pages, 1959 ; Ronken & Lawrence, 
1952; Stewart, 1957; Vander Zaden, 1959), 

In recent years, however, the possibility 
that employee attit d change may 


ostility and in- 


(1958) and by 
€pt of readiness 


‚ Trumbo, Cheek 


a weak negative relat 
job satisfaction but to 
favorability toward pe 
(Trumbo, Nangle). 
ward change, specifi 

l'This research was su 


Labor and Industrial Rel 
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Р1оуеез' general readiness for change, satisfac- 
14 job aspects, and desire for job-aspect 
ypothesis that а person's desire for specific 
the discrepancy between the attractiveness to 
haracteristics but also by his assessment of the 
thesis is upheld by results o 
gate scores and of data for several indiv 


f multiple-regres- 
idual job aspects. 


employee suggestion plan, appeared unrelated 
to the person's own readiness for parie 
(Hardin, 1964), but it was unclear Laien 
Suggestions were usually intended to imer 
changes in the work of suggesters or ye ot 
they sought instead to remove the need i 
further adjustments by causing changes in ү. 
Work of others. At the same time, participan i 
in the plan usually worked under supervises 
whose readiness for change was intermedia o 
rather than high or low, and who may Ed 
fore perhaps have been permissive, albeit 2 
eager, toward efforts to generate modificat!o 
in work methods or environment. di- 
Logical analysis of the nine slightly Dn 
fied items used in work by Faunce, Har a 
and Nangle suggests some heterogeneity- pa 
of the items (Nos. 1 and 5) seem to ue 
the respondent's attitude toward a perle 
Benerating changes in his own work, ene 
the rest ostensibly cover his attitude се 
having his work changed by others, The la iv 
attitude, which might be regarded as pa5? 
readiness for change, is likely to dominate, | 
sheer number of items, the active readin " 
possibly reflected by the other two ite? 
Furthermore, one item (No. 8) appears 
express passive readiness for change in te 
of the salary increase needed to сотреп5а 
the respondent for a job shift, which unf? 
tunately makes his objective or subject” 
economic circumstances a part of meas, 
readiness. In Contrast, six items measure P , 
Sive readiness in more direct, affective tet” 
Nevertheless, the main content of the set " 
nine items Seems to be preference hew 
constancy and change in job content, with ! 
explicit specification of the states of aff e 
existing before and after the supposed cha? 
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cues the respondent might perhaps specify 
е. d some of the characteristics of the 
ien quo ante and post, the set appears to 
initi an attitude toward a process of change, 
lated by the respondent or his environment. 
sur o present paper offers and tests a primi- 
Fd cory of employee desire for specific 
state of When choosing between a potential 
charact Pn described by a vector of job 
dune ше, and his present state of affairs, 
of job zn by a quantitatively different vector 
sider t Characteristics, the employee will con- 
"ees factors: (a) how well off (not purely 
of айаш у) would he be in the potential state 
is well. once he got there, as compared with 
and (5) eing in his current state of affairs? ; 
Tepulsio what attractions . (challenges) and 
involve T (dangers and nuisances) would be 
Of s d in getting from here to there? Desire 
а о changes is heightened both by 
State yd of the potential over the initial 
е ver affairs and by positive desirability of 
ess its oram of change. If the change proc- 
desire " is viewed as undesirable, little or no 
When Ful Specific changes need emerge, even 
tentia] € status quo is inferior to the po- 
is hee of affairs. If the change process 
change ed as desirable, desire for specific 
quo ae d emerge, even when the status 
of affaire lal or superior to the potential state 
c Ua additional satisfaction obtainable by 
ive p from the status quo to an alterna- 
enjoyed. Preferred state of affairs may be 
ependi for a short while or for a long time, 
Sons wae. among other things on the per- 
far ork-life expectancy. Being in the nature 
should 1. of flow, the additional satisfaction 
Nence ry weighted by the expected perma- 
Cause bs the alternative state of affairs. Be- 
to ma Пу one distant year may be presumed 
tter less than any one year lying in the 
Uture, the weights should increase with 
"ence, but less than in strict proportion. 
© weights are left implicit, the level of 
re, ше additional satisfaction will matter 
i. ative to the desirability of the change 
Short, Among those with long rather than 
Work-life expectancy. 
form S, theory may be restated in testable 
(ау ’ df one makes the following assumptions: 
Jacobs € readiness-for-change score of the 
Оп group reflects the respondent's as- 


Der 
Tf а 


Obtai 


sessment of the desirability of the change 
process itself; (b) a conventional job-satisfac- 
tion score dealing with specific job aspects 
reflects the desirability of present compared 
with potential job aspects; and (c) the fre- 
quency with which the respondent expresses 
a desire for change, in the direction of his 
choice, in the specific job aspects covered by 
the job-satisfaction score reflects the extent 
to which he wants specific changes in his job. 

Statistically the theory then has a number 
of testable implications: 


1. The desire for specific changes is posi- 
tively related to general readiness for change 
and negatively related to job satisfaction. 

2. The desire for specific changes regresses 
more strongly (the partial regression co- 
efficient being larger in absolute terms) upon 
job satisfaction than upon general readiness 
for change among those with long work-life 
expectancy than is the case among those with 
short remaining work life. 

3. If the range of attitudes in a given 
sample of respondents is sufficiently large, one 
will find some respondents who desire change 
in job aspects, although they are completely 
satisfied with them, and some who desire no 
change in job aspects, although they are 
strongly dissatisfied with them. 

4. Readiness for change, representing the 
subjective magnitude of adjustment required 
by the process of change, is a more important 
factor in the desire for change in some job 
aspects than in others. Desire for specific 
change regresses more strongly upon it when 
a change in the amount of a job aspect re- 
quires much adjustment by the individual, 
such as might be the case with a change in the 
amount of skill, than when a job-aspect change 
requires little adjustment, as might be true 
for a routine change in pay. 


The rest of the paper describes a test of 
the first and second implications of the theory, 
reports findings bearing on the third and 
fourth implications, and suggests some im- 
provements in research design. 


RESEARCH SITE AND DATA 


The material for this study was obtained from 
the first of two questionnaire surveys that had been 
conducted by the author and associates in the 
School of Labor and Industrial Relations as part of 
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an earlier longitudinal study of employee response 
to technological change. The surveys took place in 
a medium-sized insurance company which in the 
intervening period installed an IBM 650 electronic 
computer for data processing. The questionnaires, 
which were identified, were administered by the 
staff of the School. More than 90% of eligible em- 
ployees, including first-line and some higher super- 
visors, participated in each survey. Further details 
on the nature and administration of the question- 
naires, the participation rates, and the available 
findings on employee response to technological change 
can be found elsewhere (Faunce, 1960; Hardin, 
1960; Nangle, 1961). 

The questionnaires completed by the 246 em- 
ployees who participated in both surveys constituted 
the basic data pool. Questionnaires lacking answers 
to one or more of 37 items dealing with desire for 
change, job satisfaction, and readiness for change 
were eliminated. This strict rule reduced the study 
sample to 199 persons. 

Information on desire for change in 14 job aspects 
and on satisfaction with the same aspects was ob- 
tained from a checklist contained in the first survey, 
The aspects were worded as shown in Table 3. The 
employees were asked to indicate whether they were 
“completely satisfied,” “very satisfied,” “quite satis- 
fied,” “somewhat satisfied,” or “not satisfied” with 
each aspect. They were also asked to indicate whether 
they wanted to see “an increase,” “no change,” or 
“a decrease” in that aspect. (The concepts of in- 
creases and decreases in a job aspect were pre- 
sumably familiar to the respondents, because ques- 
tions about perceived change in these aspects and 
about computer impact upon them had been asked 
at earlier stages in the questionnaire, and because 
illustrative examples were given in connection with 


each of the checklists in which the questions were 
asked.) 


TABLE 1 
Propuct-Momenr CORRELATIONS AMONG Items 


Size of correlation coefficient 


Item set 
Lowest | Median Highest 
Readiness for change | —0.06 0.20 0.46 
Job satisfaction 0.19 0.51 0.72 
Desire for change 0.00 0.26 0.55 


Note.—This table is based on data 
The distributions of correlation coefficie 
pairs of items in the readiness-for-change 
in the other two scales, 


for 199 respondents. 
nts are based on 36 
scale and on 91 pairs 
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TABLE 2 


FREQUENCY DISTRIBUTIONS OF INTERCORRELATIONS 
AMONG READINESS-FOR-CHANGE ITEMS 


А " Between 
Among items 
Coefücient of Among items с 58, 
: items ROS. tpe 
correlation nos. 2,3,4, d nos. 
nos. 1,5,8 7 an 
2, 6,7,9 2,3,4,6,17 
eae 
—10 —.01 1 
+.00 — 09 2 3 
A0 19 1 8 
20 29 3 5 
30 39 6 
40 49 5 
Total frequency 3 15 18 


Note.—N = 199, 


The level of satisfaction with an aspect was е 
pressed numerically by assigning the arbitrary WelE 
of 1, 2, 3, 4, and 5 to the five categories of respon а 
from "completely satisfied" to “not satisfied," € 
job-satisfaction score was computed for each Pe 
by summating the 14 weights corresponding 0 the 
response categories he checked апа reversing 
direction of scoring. nses 

Readiness for change was measured by тезро) by 
to slightly modified versions of the nine items use pich 
Trumbo. Eight of these were statements to w 
the employee was asked to respond by stating gre? 
“I strongly agree,” “I agree a little,” “I neither Pagi 
nor disagree," "I disagree a little,” and “I str? 
disagree." The statements were as follows: 


the 
1. If I could do as I pleased, I would change 
kind of work I do every few months, е 
2. One can never feel at ease on a job bee 
Ways of doing things are always being change „st 
3. The trouble with most jobs is that YO" joy 
get used to doing things in one way and then 
want you to do them differently. тс 
4. I would prefer to stay with, a job I know pin 
handle than to change to one where most 
would be new to me. they 
5. The trouble with many people is that whe? о, 
find a job they can do well they don’t stick МЕ 
6. І like a job where I know that I will be © e 
my work about the same way from one week н 
next. 
. 7. When I get used to doing things in one ways 
is disturbing to have to change to a new metho® jy 
8. It would take a sizable raise in pay to £* 
to accept a different job here. 


0 
The items were presented in the above order, but ^i 
in the form of a checklist. The ninth item WA gl 
the controlled-completion type, that is, The job о 
You would consider ideal for you would be n 
Where the way you do your work: is alw2X5, ti 
Same; changes very little; changes somey os! 
changes quite a bit; changes a great deal. 
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items were separated by more than a dozen mimeo- 
graphed pages from the checklists for job satisfaction 
and desire for specific changes.) A total score on 
ет А for change was computed by assigning 
e ues from 1 to 5 to the response categories ranked 

ascending order of readiness and summating the 
Weights. 

The distributions of item correlations are sum- 
woe in Table 1. The reliability of the two 14-item 
th es appeared to have been fairly high. However, 

с readiness-for-change items appeared fairly hetero- 
jur QU Робат inspection of the correlation matrix 
items wness-for-change items showed that the three 
е discussed earlier (Nos. 1, 5, and 8) were not 
tek closely related to each other and to the other 
sug inn as can be seen from Table 2. This finding 
sd pes: that one score should be computed for the 

Six passive readiness-for-change items and 


3 = 8.858 — 0.150%. + 0.271 — 0.312x3 — 0.346x4 + 0.104x; 


(0.021) (0.046) 
р< 01 р< 91 


К R? = 0.33, corrected for degrees of free- 
От. The coefficient of multiple correlation 
$5 statistically highly significant, as were the 
rst two partial regression coefficients. 
А Аз may be inferred from the standard er- 
ors, shown in parentheses, the desire for 
on iie changes did not regress significantly 
iter the three separate readiness-for-change 
а MS. Further analysis showed that there was 
30 no significant regression on a score formed 
"a Adding these three items and that the 
un “a of the corrected R? remained virtually 
ati anged both when the .3-item score was 
Wi Sütuted (0.32) and when all three items 
‘te eliminated from the regression equation 
& 31). Since variables xs and x4, as well as 
"5 Were only weakly, if at all, associated with 
a aggregated into variable хэ, this 
or ing indicated that high active readiness 
ips Ee did not lead to a high desire for 
Signe change in job aspects. Curiously 
acti Bh, the regression weights for the two 
lVe-readiness items were negative, while 
Ben Tegression weight for the 6-item passive- 
0 Mess score was positive. Since the former 
signin ession weights were not statistically 
artif, Cant, the negative signs were probably 
acts calling for no particular explanation. 
or di Subsequent analysis involving readiness 
the уу Бе was confined to the score based on 
ta | Passive-readiness items. After variables 
Bres, 4› and хь were dropped, a simplified re- 
Ston equation was computed: 


that the other three items might be used as separate 
variables in the regression analysis. 


RESULTS 


The ordinary least-squares procedure was 
used for estimating the constants and partial 
regression coefficients of a linear multiple-re- 
gression equation which had the 14-item de- 
sire-for-change score as dependent variable 
(у), and which had as independent variables 
the 14-item job-satisfaction score (ху), the 6- 
item passive readiness-for-change score (хз), 
and the scores on the remaining individual 
items Numbers 1, 5, and 8, or xs, x; and 25. 
The resulting regression equation was: 


11 
(0.162) (0.178) (0.163) 
р> 05 р> 05 р> 205 
3 = 7.683 — 0.146х,4- 0.2452» #2 = 0.31 [2] 
(0.020) (0.043) df = 196 
p< Ol р<01 


Because job satisfaction (x1) and readiness 
for change (xs) were virtually uncorrelated 
(r12 = — 0.09), the regression coefficients were 
not likely to have been affected importantly 
by multicollinearity. The partial correlation 
with desire for change 


(з = — 0.45, 7, = 0.38) 


were both very significant. Statistically, there- 
fore, desire for specific changes was associ- 
ated inversely with job satisfaction and posi- 
tively with passive readiness for change, so 
that the first implication of the theory was 
supported by the evidence. 

The regression equation, while highly sig- 
nificant, left unexplained as much as 69% of 
the variation in desire-for-change scores. A 
variance analysis was made of the residuals 
(errors of estimate) for respondents grouped 
according to whether they were high, medium, 
or low on readiness for change and on job 
satisfaction, but it failed to show any sta- 
tistically significant differences (№ > .20). 
Whether the equation represented the data 
adequately at the logical extremes of the in- 
dependent variables could not be directly 
tested, because few respondents had scores 
close to the boundary lines. When respondents 
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indicated being “not satisfied” with an in- 
dividual job aspect, they invariably wanted a 
change in it. This fact suggested either non- 
linearity or errors in regression estimates. 
Furthermore, the regression equation predicted 
that if persons could be found who were com- 
pletely satisfied with all job aspects, and not 
at all ready for change, they would show a 
frequency of desire for change, averaging —1.3 
aspects. This logically absurd prediction 
might also indicate nonlinearity at extreme 
values of independent variables, but the dis- 
crepancy from zero desire for change lay 
within the boundaries resulting from random 
errors in the regression coefficients. Since the 
respondents were classified into the three 
groups of high, medium, and low on each 
independent variable for the analysis of 
variance and since the F ratios were all below 
1.0, it seemed reasonable for general purposes 
to disregard the weak evidence to the con- 
trary and to regard the regression as linear in 
each variable and additive, 

Two interesting implications of Regression 
Equation 2 should be noted. First, if a per- 
son is very unready for change (xə = 6), he 
will not desire change in all job aspects (y 
= 7.7), even if he is “not satisfied” with each 
of them (х; = 14). Similarly, if he is very 
ready for change (хә = 30), but is “com- 
pletely satisfied” with each of the job aspects 
(xı = 70), he will nevertheless want to see 
change in some of them (y = 4.3). This tends 
to support the third main implication of our 
theory. 

The questionnaire also contained the item, 
“How many more years do you expect to 
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work?" The response categories were “less 
than 1 year,” “1-2 years,” “3-5 years,” e 
10 years," “11 or more years," and “I don't 
know." The 199 persons were grouped into 
four categories of expected work life as shown 
in Table 3, and separate regressions were run 
to test the second implication, that job satis- 
faction increases in importance relative to 
readiness for change, as expected work life i5 
increased. The results did not contradict the 
general proposition that desire for specific 
change regresses positively on job satisfac- 
tion and negatively on readiness for change, 
although some coefficients were too small to 
be significant. The second implication, 00 
the contrary, was definitely not upheld by the 
results. While the differences among regres 
sion coefficients for job satisfaction were nO 
statistically significant, the coefficients seme 
to decrease with increased expected work li Р 
and did not rise in relation to the regressio” 
coefficients of readiness for change. This I€ 
sult suggests that the expected durations к 
the two states of affairs do not affect the 
desire for specific change. One other st? 
tistical result cautions against accepting ti? 
conclusion firmly. fot 
While job satisfaction and readiness a 
change were approximately independent ‘| 
the last three categories (r = 0.06, 0.12, pom 
—0.00, respectively), they were rather high? 
correlated (r— —0.50) in the group having 
remaining work-life expectancy of up #0, P 
years. This may have biased the RM. 
magnitudes of the two regression coefficien! 


; = B tas 15 
in that group, but the direction of the bias 
not obvious. 


TABLE 3 


EFFECTS ОР Wonx-LirE Ex 


PECTANCY UPON | 


REGRESSION. RESULTS 


T P —— = — — 
А Remaining work-life expectancy’ 
Statistic = — M = 
0-2 уеагѕ 3-10 years 11 or more years Don't know 
Sample size 38 32 52 77 
R? corrected for d/’s 0.31 0.29 0.17 0.25 
Job satisfaction ` | 
Regression coefficient —0.20 —0.13* —0.15 0:12 
Standard error 0.06 0.05 0.04 0.03 
Readiness for change ` ` 
Regression coefficient 0.07^ 0.30 0.098 0.21 
Standard error 0.11 0.10 0.10 0.07 
— же -— ` a 


Note.—Correlation and regression coefficients are significan 
a ns at the 5% level, 
*p «.05. 


nt at the 1% level, unless otherwise stated, 
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The fourth implication of our theory was 
tested by analysis of each of the 14 job 
aspects. The desire for change in one job as- 
pect would probably depend somewhat on the 
level of satisfaction with some other job 
aspects. This appeared particularly likely for 
Pairs in which one aspect was pay, the prime 
Compensation for jobs deficient in other re- 
gards. Nevertheless, the desire for change in 
any one aspect was not hypothesized to regress 
on satisfaction with other aspects, because the 
peh intercorrelations among the 14 job-satis- 

ction items (see Table 2) would probably 
iis the regression weights unduly sensitive 
9 extreme observations. In brief, the desire 
ax, Change of the i-th person in the j-th job 

Spect was hypothesized to be governed by 
the relation: 


Уй = aj + bij tuj + бер ei F € [3] 
Where 


1 if the i-th person wanted a change 


Уу = n aspect j 
0 otherwise 


%; = the constant term for aspect j 
čij = the i-th person's satisfaction with the 
j-th aspect 
® = the i-th person's score on the 6-item 
Passive readiness-for-change scale 
common to all 14 equations 


q= the error or disturbance term for the 
i-th person on the j-th aspect. 


Mia choice of both estimation method ane 
relati cance tests would depend greatly on the 
ei al "Ships between the disturbance terms 
term the 14 equations. If the disturbance 
Mie E uncorrelated, the ordinary single- 
Propriae least-squares method would be = 
lee for estimating the regression coe! 
9f gj 5 and for conducting the required tests 
tiv Snificance, Tf they were correlated posi- 
o ie Ог negatively, it would seem preferable 
"е, зе а two-stage estimation procedure a 
ing , cen developed by Zellner (1962). Accord- 
estin, ellner this procedure “yields coefficient 
effici ators at least asymptotically more 
estimat than single-equation least-squares 
dist з [p. 977],” particularly when the 
the bance terms are highly correlated and 
of this ependent variables are not, and much 


gain is attained even in samples of 35 


observations or less. However, it is slightly 
inferior to the single-equation approach, when 
the disturbance terms are uncorrelated and 
the observations are few. 

The great similarity-in-choice situation 
which the respondent faced in reacting to dif- 
ferent job aspects suggested that if some 
omitted variable was relevant in one job 
aspect, it would also be relevant in several 
other aspects and that individual variation 
in such a variable would therefore make a 
number of the residual correlations non-zero. 
For this reason the Zellner method was 
adopted. The calculations were performed on 
the Michigan State University CDC 3600 
computer system using a program (ZEF) that 
had been developed by W. L. Ruble * from the 
Stroud and Zellner (1962) CDC 1604 version 
and that provided not only the efficient esti- 
mators and their appropriate standard errors 
but also calculated the requisite F statistics 
for tests of homogeneity of efficient estimators. 

The residual correlation coefficients were 
found to range from —0.05 to +0.50, with 
a median value of 0.22. Judging by Zellner's 
(1963) Table 1 and the fairly large number of 
observations there was probably some gain, 
and little risk of serious loss, except for com- 
puting time, in using the Zellner approach. 
The efficient estimators, their corresponding 
standard errors, and the significance levels 
are shown in Table 4 for the two independent 
variables on each of the 14 job aspects. 

The regressions of desire for change upon 
job satisfaction were negative and highly sig- 
nificant for all of the 14 job aspects. In con- 
trast, only 8 of the regressions upon readiness 
for change were highly significant individually. 
Nevertheless, the signs of the regressions were 
nonnegative in all 14 cases. The main hy- 
pothesis of the paper was therefore strictly 
upheld in a majority of cases, and in no case 
was it contradicted by a significant regression 
having the wrong sign. 

The table also suggests, however, that the 
regression relationship was not the same for 
all job aspects. Direct statistical tests of the 
hypothesis of homogeneity, namely, the 
equality of all 14 regression coefficients for 
each independent variable, confirmed this im- 
pression strongly: the test statistics were F 
— 2.74, and F = 3.88, respectively, as com- 


i Г n . 
2 Department of Agricultural Economics, Michigan 
State University. 
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TABLE 4 
REGRESSION ANALYSIS OF DESIRE FOR CHANGE: EFFICIENT ESTIMATORS FOR 14 JOB ASPECTS 


Job aspect 


- The amount of variety in my work. 

- The amount of work required on my job. 

- The degree of accuracy demanded by my job. 

‚ My control over the pace of my work. 

- The importance of my job for the company. 

- The amount of supervision I get on my job. 

- The amount of skill needed on my job. 

- The amount of responsibility demanded by my 
job. 

9. The amount of planning I have to do on my job. 

10. The amount of judgment I have to use on my 

job. 

11. The degree to which my work is interesting. 

12. The amount of security I feel on my job. 

13. My chances for promotion to a better job. 

14. The amount of pay I get on my job. 


со з Сул PWN 


Job satisfaction Readiness for change 

ba SE b SE 
—.224 .023 .026 m 
—.189 027 024 jon 
—.102 .030 .000ъ r^ 
—.226 .024 .012* 00 
"78 .025 .033 p 
—.176 024 .004b E 
—.189 028 .022 .00 
—.204 027 .014* .006 
— 473 .026 014 .006 
—.208 .024 .022 pe 
—.257 022 .020 pon 
—.238 025 .007^ pi 
— 206 019 027 008 
—.141 019 .009* .00 


з All regression coefficients are significant at the 1% 
b xs at the 5% level. 
*) «.05. 


pared with 1.69 SF o5 < 1.76 and 2.07 < 
Fo. < 2.20 with df=13 and 2744 (see 
Zellner, 1962, pp. 366-367). The null hy- 
potheses of uniformity of regression coefficients 
among job aspects were therefore rejected, 

If the desire-for-change components at- 
tributable to job satisfaction were definition- 
ally identical with job satisfaction except for 
sign reversal, one would have expected no 


particular aspect а, 
bility of seeing, 
job aspect. 

The significant variation 
for-change component also 
relationship to desire for change was not one 
of definitional identity. They might reflect 
differences in the length, hazards, and оррог- 
tunities, or effort involved in the change 
process associated with movement from one 
job aspect to another. Tt seems natural that 
desired changes (typically increases) in the 


5 in the readiness. 
indicated that the 


level, unless otherwise noted, 


amount of variety and importance of the jo 
and in the skill and judgment it requi" E 
might call for substantial adjustments by t d 
individual which would not be needed “© 
рау increase, which in this company ee 
usually of a periodic, routine nature, OT 

change in the amount of supervision. 3 
these explanations are ad hoc and call for SY 


stona! 
tematic testing on the basis of addition 
variables, 


1 


Discussrox 


The weakness of the (statistically very eed 
nificant) relationship between job satisfactia i 
and desire for specific changes, the variat! 
in this relationship from one job aspect e 
another, and the presence of a significant с 
gression of desire for change upon pas 
general readiness for change have an implici 
tion for research procedure: desire-for-cha?e 
questions cannot safely be used to obta 
simultaneously a measure of job satisfacti? 
and an indication of the direction of change : 
job aspects needed to raise satisfaction. мо 
fundamentally, Beneral but passive readind 
for change affects the frequency of desire 
specific changes that may be expected at 2” 
given level of job satisfaction. This is x^ 
both as reflected by aggregate scores and f n 
а number of individua] job aspects. The 7 


| 
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p - desire for specific changes upon 
change isfaction and general readiness for 
aspect Meg significantly from one job 
iinlicn. h OPER probably in response to 
include ihe interacting variables which may 
the individ importance of the job aspect to 
experienci Dal, the subjective probability of 
nature "e a change in the aspect, and the 
change = extent of the very process of 
amount ed with an alteration in the 
Steel any particular job aspect. . 
Suggest r1 improvements. in research design 
and e uiia Em choice of more distinct 
a е istant response categories for the 
Sponse т си items, provision of several re- 
Change rene for the individual desire-for- 
itional ems, and explicit introduction of ad- 
е stud explanatory variables. Replication of 
шау ыг on the basis of such improved data 
tested p throw further light on the main idea 
desire E nd supported in this analysis: the 
governed | specific changes in job aspects 15 
e attr not only by the discrepancy between 
disant of existing and potential job 
ment of m. tics but also by the person's assess- 
€ very process of change. 
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The revised SVIB was administered to 
analyses were limited to 1,003 males 


experience, whose 


primarily in their greate 


chanical pursuits, and their lesser interest in people. T 
similar to optometrists, chemists, engineers, production 


science teachers, 


programmers and men in general. 


adequately 
key developed on half 


ining half discriminates well between 
Satisfied Programmers score significantly 


higher on the key than dissatisfied programmers. 


Data processing is a rapidly growing oc- 
cupation based on one of mankind's most sig- 
nificant technological developments— the elec- 
tronic digital computer—and it promises to 


mportant occupa- 
new, data process- 
widely understood 
nd popular stereo- 


much reality 
the existence 


and of 


cCornack in processing 
and analyzing the data, 
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8 
Subjects. Subjects (Ss) of the study were po 
computer programmers obtained from three ume 
The largest number (1,170) came from 91 D 
industrial, educational, and governmental organ 
tions that participated in a 1963 salary &urver i 
data-processing personnel. From 264 organizati s 
Tepresented in the survey, 130 were selected 2. 
tematically to represent a cross section of organ, 
tion types and data-processing staff sizes and hes 
asked to participate in the study. A total of 91 jals 
ganizations agreed and were sent research mater 
for 1,310 Ss. All contacts with individual Ss in th s 
organizations were made through research eai 
nators in each Organization. Responses were айбы, 
mous, but feedback of results to participants ie 
made possible by а code-number list maintained э 
each coordinator, Of the 1,310 sets of materials cd. 
tributed, 1,170, or 89%, were completed and peut 
А second group of 117 programmers was ора 
through the Association for Computing Machin os 
(ACM). From the national ACM membership put 
а sample of 208 members of 1- and 2-years standi ге 
was obtained. These members were invited to P? 
ticipate in the Project, and the 137 who agreed (0 
$0 were sent the research materials directly by ™ 
The 117 com 
85% of those Who agreed 
of th j 


ай. 


à return rate of 82 
ticipate and 5496 
PMA Eroups we 
Research instru 
completed the in 
1962) and a ba 
including items 
history, job 


Те not anonymous, dy 
ments. Each participant in the st g 
terim revision of the SVIB (Бүгө, 
ckground information question? 
on age, sex, educational and ne 
characteristics, programming qualific 
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m and a statement of satisfaction with program- 
possible. an occupation. This information made it 
paticis to understand more clearly the nature oí the 
аа sample, to define the final experimental 
subgrou and to examine variations in interests among 
ona MI of programmers. All data were collected 
each Errare e answer sheet. Instructions for 
Pose of fe ce included an explanation of the pur- 
both th SV project and directions for completing 
for an SVIB and the background data form and 
Тш eee them directly to the project office in a 
5 n envelope provided. 
ub characteristics. The data-collection pro- 
ut not "DRE participation in the project primarily, 
gramm exclusively, to bona fide computer pro- 
eliminate | Background data were used, therefore, to 
less {ш from the sample: (a) those who indicated 
Cases) Mn 2 years of programming experience (78 
job di end (b) those who indicated their primary 
managing to be instructing programmers (9 cases), 
or ортан data-processing installation. (27 cases), 
total sa ing computer equipment (3 cases). The 
excluded pe included 186 females, and these were 
consid from the primary sample because of the 
boe ger evidence of differences in the vocational 
evidence of men and women (Strong, 1943). Some 
Eroups * suggests that limiting interest-key criterion 
eir Ps individuals who express satisfaction with 
erry Ccupation will result in more effective keys 
satisfies Consequently a simple indication of 
quested ion with the programming field was re- 
Pants Rhee background data form, and partici- 
ог “defi о indicated that they “probably” (81 cases) 
Were o. nitely” (15 cases) would prefer another field 
ex Xcluded from the primary sample. Restrictions 
tion ot primary duty, sex, and job satisíac- 
аана the primary sample from 1,378 to 1,003. 
restriction of Ss excluded from the sample by а single 
в FALL retained for separate study. 
20 to Үү HE the primary sample ranged in age freto 
Slandarq’ Wih a median of 31.8, mean of 32.8, A 
clude deviation of 6.5. The age range of 254 
Program 90% of the sample. More than 90% n 
Were mers had attended college, and two-thirds 
College graduates. Among those reporting a 
r muon more than twice as many indicated a 
n mathematics as іп any other single field. 
EE common were business administration 
Ported 216118. All but 10% of the programmers re- 
the ay Some kind of formal training in programming, 
erage amount being 174 hours, equivalent to 
of full-time training. About 907 had 8 
Velo S less experience, reflecting the recency of = 
tre e nt of the programming field. More than hal 
tha ™ployed in industrial organizations, and more 
Wer Wo-thirds of those from known organizations 


еве 


Har op mers of staffs of at least 50 programmers. 
busines ths Programmers were engaged primarily in 
in vies, Programming, which is somewhat surprising 
"lenti Of the preponderance of mathematical and 
of the ^ educational backgrounds. Another fourth 
Progra Programmers were doing primarily scientific 
| were divided 


Ming, and the remainder 


equally among combinations of business and scientific 
applications, military systems, and other applications, 
primarily nonmilitary soítware systems. More than 
half the programmers in the sample were receiving 
between $700 and $900 per month, and the median 
salary was exactly $10,000 per year. 

Procedure. The answer sheets were scored on 59 
existing SVIB keys, and each participant was sent a 
profile of his individual scores. Similarity oi pro- 
grammers' interests to those of previously keyed oc- 
cupations was assessed in terms of mean scores of the 
primary programmer sample on these keys. 

Four experimental programmer interest keys were 
constructed from item responses differentiating a 
programmer criterion group (a randomly selected 
half of the primary programmer sample, W = 500) 
from a reference group representing an equal sam- 
pling of all of the criterion groups on which existing 
SVIB occupational keys are based. The remaining 
half of the primary programmer sample (№ = 503) 
was used to evaluate the validity of the keys. 

From the findings of Clark (1961), Nash (1965), 
and Strong, Berdie, Campbell, and Clark (1964) it 
appeared that a vocational interest key should be 
composed of 40-80 items selected to emphasize 
heterogencity of content and scored with unit weights. 
In addition, Campbell * has suggested that better keys 
may result from scoring “Like” and “Dislike” re- 
sponses to keyed items in opposite directions regard- 
less of whether both responses significantly differ- 
entiate criterion and reference groups. The following 
keys were therefore developed as experimental pro- 
grammer interest keys: 

Key A. Composed of all responses to which the 
criterion- and reference-group percentages differed by 
15% or more. Responses with larger criterion-group 
percentages are scored +1, and those with larger 
reference-group percentages are scored —1. 

Key B. Composed of all items ior which the cri- 
terion- and reference-group percentages of either 
“Like” or “Dislike” responses differed by 1596 or 
more and for which the percentage diíference for 
the “Indifferent” response was the smallest of the 
three, Responses with larger criterion-group per- 
centages are scored +1, and those with larger refer- 
ence-group percentages are scored —1, regardless of 
whether both responses to an item met the 15% 
difference criterion. 

Key C. Composed of all responses to which the 
criterion- and reference-group percentages differed by 
12% or more. Responses are scored as in Key A. 
Although separately analyzed, this key was de- 
veloped primarily as an item pool for Key D. 

Key D. Following the procedure outlined by Clark 
(1961), a sample of 500 men in general was scored 
on Key C; the upper and lower 2796 of scores were 
identified; and the percentage differences in the re- 
sponses of these two groups were computed for each 
item in the pool and used as indexes of response 
homogeneity. A bivariate plot of item statistics was 
prepared, with validity index (percentage difference 
between programmers and men in general) on one 


— I. H 
2D, P. Campbell, personal communication. 
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TABLE 1 


MEANS AND STANDARD DEVIATIONS OF COMPUTER 
PROGRAMMERS’ ScorRES ON Existinc SVIB Keys 


Key M SD 
Optometrist 40.95 11.59 
Physical Therapist 33.32 11.50 
Dentist 26.80 | 10.71 
Osteopath 27.04 | 09.69 
Veterinarian 20.95 10.88 
Physician 35.04 | 11.98 
Psychiatrist 34.74 10.64 
Psychologist 3421 11.42 
Biologist 35.61 11.54 
Architect 31.42 11.09 
Mathematician 31.55 12.06 
Physicist 27.42 14.31 
‘Bagineer 41.81 | 11.29 
Production Manager 39.92 08.66 
Army Officer 35.78 12.58 
Airplane Pilot 36.83 10.64 
Carpenter 24.11 12.65 
Forest Service Man 25.16 | 11.97 
Farmer 32.31 | 09.90 
Industrial Arts Teacher 29.34 | 10.80 
Math-Science Teacher 4045 | 0922 
Printer 29.93 | 0941 
Policeman 28.55 | 08.86 
YMCA Physical Director 2400 | 1217 
Personnel Director 35.00 1194 
Public Administrator 38.86 09.87 
Rehabilitation Counselor 31.69 10.84 
YMCA Secretary 2090 | 12.58 
Social Worker 2896 | 12.39 
Social Science Teacher 2735 | 1142 
School Superintendent 27.66 | 12.14 
Minister 21.60 11.96 
Librarian 3199 | 1218 
Artist 2486 | 1093 
Art Teacher 2214 10.8 
Musician Performer 37.60 104 : 
Music Teacher i ш 
30.06 11.00 
С.Р.А. Owner 
Senior С.Р.А, 8 bes 
Accountant ee а 
Office Worker 2058 ТОЕ 
Credit Manager 3538 Mos 
Chamber of Commerce Executive 33.80 ux 
Business Education "Teacher 31.70 p 
Purchasing Agent 31, i 
Banker Pt 05] 
Pharmacist FEH 00б 
Mortician m | mm 
25.29 | 09.06 
Sales Manager 25.75 
Real Estate Salesman ў 7007 
5 29.54 07.37 
Life Insurance Salesman 21.48 09. 
Advertising Man 28.42 ie 
Lawyer 32.32 0935 
Author-Journalist 28.64 08.62 
President—Manufacturing Concern 25.39 10.95 
Specialization Level 45.75 | 09.55 
Occupational Level 58.44 06.85 
Masculinity-Femininity 49.53 08.42 


axis and homogeneity index (percentage difference 
between upper and lower groups of scores on Key C) 
on the other. A line drawn through the plot divided 
item responses with moderate validity indexes and 
high homogeneity indexes from those with very high 
validity indexes or with moderate validity indexes 
and low homogeneity indexes. The former responses 
were eliminated from the key, and the latter were 
retained. As examples of the effects of this process 
all responses with validity indexes larger than 25 
were retained; items with validity indexes of 12-18 
were eliminated if their homogeneity indexes were 
about 30 or above but retained if they were about 
20 or below; items with validity indexes of 20-25 
were eliminated if their homogeneity indexes we! 
about 50 but retained if they were about 30. 


RESULTS 


Interests of computer programmers. Means 
and standard deviations of the primary sample 
on 59 existing SVIB keys are given in Table 
1, and the means are shown in profile form i? 
Figure 1. The group has no very high mea? 
scores—none in the A range. It is appare”! 
that no one of these existing keys adequately 
represents the interests of computer program" 
mers. Neither are there any extreme rej 
Scores; only two of the eight mean scores 
in the C range fall below the middle third 0 
men in general. Six of the mean scores— OP" 
tometrist, Chemist, Engineer, Production Мат 
ager, Math-Science Teacher, and Senior CE 
—fall in the B+ range; and there are addi- 
tional clusters of fairly high scores in 
biological science and business detail grouP? 
оп Personnel and Public Administrator; x 
Pilot and Army Officer, and on the Musicia® 
key. The rather low scores on both Math? 
matician and Physicist contrast with k 
heavy emphasis on college training in math? 
matics among the programmers in the sample 
These two keys were based on mathematicia? 
and Physicists listed in American Men / 
Science, including College professors. TR 
much higher scores on Engineer and Chemist 
Suggest that the mathematical and scienti 
interests of programmers are definitely аР” 
plied rather than theoretical. The slightly 
elevated mean score on the Musician key РЇ” 
vides some, but not very strong, support fo" 
the prevalent belief in a relationship Бебе, 
Programming and musical activity. In E 
eral the profile of this group is similar to 2, 
obtained by Reinstedt et al. (1964), the P. 
mary difference being a larger number 
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TABLE 2 
CHARACTERISTICS OF EXPERIMENTAL PROGRAMMER INTEREST KEvs 
| M | SD 
No. No. . 
Key items responses Менйн 2. -— Men in 
iteri Validation x Criterion | Validation eneral 
Criterion general | ш 
» .50 
A 66 102 23.93 24.03 3.17 841 8.08 ч 38 
B 51 102 18.65 18.70 —0.14 8.20 7.60 1171 
c 99 166 25.56 25.55 —344 11.12 1131 922 
D 72 106 18.74 18.74 —0.58 6.82 7.09 9 
* Estimated. 


solute amount of their interest in any area. 
Perhaps the most striking characteristic of 
programmers is their interest in problem- and 
puzzle-solving activities. Interestingly enough, 
this interest is not limited strictly to mental 
problems, as represented by a strong interest 
in all forms of mathematics, but extends as 
well to the mechanical area. Programmers 
Show some liking for research activities, but 
no more interest than other men in most of the 
Sciences themselves. Perhaps research work is 
attractive primarily as an opportunity to avoid 
routine, which appears to be particularly dis- 
tasteful to programmers, as evidenced by their 
dislike for regimentation and their preference 
for varied and even risky activities. Another 
striking characteristic of programmers is their 
disinterest in people. Compared with other 
professional men, programmers dislike ac. 
tivities involving close personal interaction, 
They prefer to work with things rather than 


with people. They also indicate dislike of Rt 
tain aesthetic activities, and it is notewor А 
that they do not differ greatly from men si 
general in their responses to any of the “mu 
cal" items in the SVIB. сай 
Experimental programmer keys. Statis " 
characteristics of the experimental program 
keys are shown in Tables 2 and 3. vw 
and D include about 100 scored responses; y 
the numbers of scored items are near the wr 
dle of the desired range. Key B contains a 
items, but inasmuch as both responses 
Scored for each item, the tota] number of o 
Sponses is the same as for Key A. Key о 
course, contains more than the ден 
number of items because it is merely à рг 
liminary item poo] to be reduced by {шї C 
analysis. Note, however, that Keys А ап i 
are nearly identical in performance yn 
the inclusion of 50% more items with p 
validities in Key C, АП four keys, in Ё 


te 


TABLE 3 


CRITERION, VALIDATION, AND MEN- 
EXPERIMENTAL Prog: 


IN-GENERAL GROUP Dr 


RAMMER INTEREST Keys 


FFERENCES ON 


Criterion group versus validation group 
Percentage of overlap 
Key With men in generals M Vari 
. ariance 
difference difference 96 over? 
Criterion Validation CR b F р 
h 
A 27 26 0.19 >.10 » 
e | 2 | & | se | se [ою [ую fas 
с 26 27 0.04 >л0 101 2.10 zi 
24 0.00 >л0 1.08 >10 W y 
— - , - — HERR —— E csi 
* Using estimated men-in-general variance, 


| 


VOCATIONAL INTERESTS OF COMPUTER PROGRAMMERS 


are similar in their performance, and all pro- 
eu e highly significant differentiation between 
programmers and men in general? Criterion 
анон groups overlap more than 99% 
in un DUAE practically no shrinkage 
bl co D is slightly the best of the 
imd m^ ut Keys A and C are nearly as 
tive ges considerable additional norma- 
dilien th on Key A, which was available 
шайл x Key D, were computed for in- 
mended n the SVIB manual, Key A is recom- 
Key. Sc аз the Computer Programmer Interest 
кел сч, weights and normative data have 
Services bx to the major SVIB scoring 
Based path letter grade conversion table 
Table 4. he validation group is given in 
programmer scores of excluded subgroups. 
ee of the four major subgroups 
LS excluded from the primary pro- 
(кече, sample—females, inexperienced, and 
major hed programmers, and those whose 
i. o Ponsibility was not a programming 
SE ie scored on the Programmer key. 
the valides: summarized and compared with 
Scores Cy group in Table 5. Average 
iens inexperienced programmers and of 
Progra: nmers whose major duties were not 
from зра: tasks do not differ significantly 
of fui: validation group, but average scores 
ато кез females and dissatisfied programmers 
— Substantially below the validation group. 


3 M ец " 
Mean scores for men in general were obtained by 


Summi 
Md the cross-products of men-in-general re- 
rather Pe centages and corresponding item weights, 
Men.in. han by scoring the men-in-general group. 
as 13 eed standard deviations Were estimated 
9n the e the validation-group standard deviations, 
“eported jo, of the standard-score standard deviations 
Str for men in general on existing SVIB keys 
ong, 1959), 


Q3 
[2 


TABLE 4 


Letrer-GRADE CONVERSION TABLE AND NORMS 
FOR COMPUTER-PROGRAMMER INTEREST KEY 


Percentage of 
distribution 
Letter Raw Standard 
grade score score a 
Validation | Revised 
Eroup generals 
A 20-56 45-90 73.4 5.9 
B+ 16-19 40-4 114 6.2 
B 12-15 35-39 84 9.4 
B- 8-11 | 30-34 44 12.6 
c+ 4-7 25-29 2.0 14.7 
с | —42-3 —32-24 0.8 51.2 
—16.3 0 
a Estimated. 


The lack of differentiation of the inex- 
perienced programmers is not surprising, but 
somewhat lower scores for the group not en- 
gaged primarily in programming might have 
been expected. Undoubtedly many in this 
group were programmers and were continuing 
to do considerable programming, even though 
they regarded machine operation, training, 
installation management as their major 
responsibility. It is possible, also, that the 
Programmer key is representative of the 
broad field of information processing as well 
as of the programming specialty within the 
field. 

The lower scores of the dissatisfied pro- 
are considered additional strong 


or 


grammers 
evidence of the validity of the Programmer 
key. Although this group is more similar in 


its interests to satisfied programmers than to 
any of the other SVIB occupational groups, 
its dissatisfaction with the field is clearly re- 


TABLE 5 


Scores or EXCLUDED SU 


BGROUPS ON THE Сом 


{PUTER-PROGRAMMER KEY 


Difference from validation group 


Group 7 M SD 
N " E. t | t Variance | p 
iff. ratio 
р ү 
males 169 20.17 793 3.86 540 | «00 100 | >10 
N sDerienced 49 25.73 8.48 —1.70 —140 2.10 1.05 >.10 
js rogram, 33 22.73 8.79 1.30 0.89 >.30 1.09 >.10 
atisfied 76 19.88 9.59 4.15 4.07 <.001 1.19 >.10 
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flected in its low average Programmer score. 
Because the members of this group have in 
common their employment as programmers 
and the interests that drew them into the 
programming field, whereas their dissatisfac- 
tions with the field and their other interests 
are likely to be widely varied, it is not sur- 
prising that no other single key represents 
their interests as wel] as the Programming 
key. 

The interests that differentiate men from 
women in general apparently differentiate fe- 
male programmers from male programmers as 
well; and the difference is sufficient to require 
Separate norms if the men’s key is to be used 
for women. It appears desirable as well to 
construct a computer-programmer key for the 


SVIB for Women, using women in general 
as the reference group. 
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COMPATIBILITY EFFECTS IN A TWO-HAND 
CRANKING TASK* 


DON TRUMBO, STEVEN ROGERS, AND LLOYD L. AVANT 


Kansas State University 


48 Ss were run on а 2-hand cranking task in 4 independent groups with dif- 


ferent control-dis 


codes and 4 response combinations. 
sponse measures. Results for total adjust- 


latencies for each hand served as re 


ment time showed significant Stimulus 
differences for Response Combinations or for t 
Combination interaction. Latency data revealed a 
effect consistent with that for total adjustme 
control of the lateral dimension yielded shorter 
of the hand involved. Thus, th 


sion, regardle: 
R-R compatibility effects. 


Cross 


Dorted 4 Noble, and Trumbo (1964) have re- 


5 itel attempt to assess compatibility ef- 
anq fir uding both stimulus-response (S-R) 
SPonse-response (R-R) effects. In that 


Study 

У, whi . s 
task, i S involved a two-hand cranking 
unction © 


compatibil 


lity), even though the latter in- 


Ol the two cranks. Thus, while demon- 
S-R effects, the results were in con- 
mt Classic principles of time and 

агпез, 1958) and with the concept 

Compatibility, as discussed by Fitts 
à mae (Fitts, Noble, Bahrick, & 
апо ), both of which would seem б 

те буо} Ptimal combination of movements 

Two i hands, 
5. Stee tations of the prior study prompted 


15 


More + 


Wise tury is, for all conditions | - 
ang pointer fe of the right-hand crank move 
clock Controlled element) to the right, 

kwise turn of the left-hand crank 

€ bointer away from S. Therefore, 


ug К : У 
CURN successive trials required all four 
"esearch the 


atc Was supported, in part, by 


e U niversity Faculty Research Fund. 


linkage. Within-group conditions included 3 stimulus 


Total adjustment time and response 


a 


Code and Practice effects, but no 
he Stimulus Code-Response 
pronounced Stimulus Code 
nt time and demonstrated that 
latencies than the in-out dimen- 
here was evidence of S-R but not 


combinations of movements of the two hands, 
all such combinations were consistent with 
population stereotypes, a factor which may 
have masked compatibility effects based on 
symmetry or identity of responses. 


METHOD 


There were 48 university males who 
served as Ss and received research participation credit 
in introductory psychology courses for their services. 

Apparatus. The apparatus described in detail in 
the prior report (Cross et al., 1964) was used, with 
minor modifications, in the present study. Basically, 
the system consisted of a 13-inch X 15-inch rear pro- 
jection screen mounted just beyond а 10 x 10 hori- 
zontal matrix of target points and opposite 5% con- 
trol cranks. The target board consisted of §-inch- 
diameter metallic contact points, 1} inch apart, on 
а dull black nonconducting background. Matrix 
уз were coded from A to J and 1 to 
10, respectively. The controls were identical light- 
in the vertical plane with a center-to- 


weight cranks i у с 
center distance of 13 inches and radii of 61 inch. One 
revolution of the crank resulted in 1 inch of pointer 


movement. Control linkage was mechanical and con- 
sisted of gears, sprockets, and bicycle chains. The 
pointer was located at the vertex of a plexiglass 
wedge, the base of which was attached to the chain 
linkage. Contact of the pointer with the correct 
target stopped а “Total Adjustment Time” clock, 
which started with the activation of a slide pro- 
jector and, consequently, with the onset of the 
stimulus. 

Continuous response records were approximated by 
having a brush, located on the back of each crank, 
sweep 16 contact points which were wired in pa 
to 16 pens on an Esterline-Angus Recorder. The wir- 
ing code was such that a half revolution of one crank 
would result in a cascade of pips across eight of the 
pens, the slope of the cascade reflecting the direction 


Subjects. 


columns and rov 
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and rate of crank movement. Contact points at 
10:00 o'clock and 2:00 o'clock positions were wired 
to а clock {ог each crank. These measured the 
latencies for 120-degree crank movement, since all 
trials were initiated from a 6:00 o'clock crank posi- 
tion. 

Stimuli. The stimulus codes, identical with those 
used in the prior study, were: (a) Instructional (Ту, 
wherein, for example, 


the target 
position, for example, “J-5,” and (c) Pictorial (P), 
which consisted of a diagrammatic representation of 
Orrect target designated 
each stimulus type, 36 


counterclockwise response ci i; 
hands (CC-C, CC-CC, C-C, C-CC) would occur with 
equal frequency throughout the series, (b) each 


lus codes, wherein they 
each code before pro- 
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ceeding to the next code. Thus, stimulus codes E | 
response combinations were balanced within Ss, W © 
C/P conditions were varied for independent group 

of Ss. 

The four C/P groups were run successively, y 
than concurrently, because of the complexity of E 
alterations necessary to change the C/P далаш) 
However, force requirements to move the cranks we 
kept constant throughout all conditions. ain 

Individual Ss were instructed in the task an "m 
the stimulus codes and received three practice ЕЕ 
оп each code before test trials began. They WERE b 
that the experimenter (E) would give a d ori] 
"ready" signal about 3 seconds before the onse M. 
each stimulus and that a red signal light would p н 
оп and the stimulus would go off when they Mr. 
contact with the correct target. Speed was PAN 
sized, but no response set (such as: “be sure to 105 
both cranks simultaneously”) was given. p 1; 
trials were run in one session with approximate!) E 
seconds between successive trials while Е iw 
clock times and reset his control panel to Same. 
the circuit for the target position of the next triat 


RESULTS 
: : resents 
Total adjustment time. Table 1 mee. 
a summary of the analysis of the total-a p 
ment-time data. Mean values for the nti- 
groups (С/Р conditions) were nearly ide 


TABLE 1 


Susmary OF ANALYSES OF VARI 


ANCE FOR Tor 
AND FOR LEFT- AND Ricut-H. 


ГАТ, ADJUSTMENT TIME 


AND LATENCIES 


CNN" 
Total adjustment time Left hands Right hand* 
Source - а 
й MS Р ars Р MS P 
Control-to-pointer roups (G 5.7. 86" | 
Tnstructional-Digital Pito A BA = "E nad ы ü 
exe ©) 5 | 3033] в 290 | 6 or | 
5/6 x § 15 7960 | 114 628 | 146 779 | $9 | 
Stimulus Code (St) F Dao e ei an 228 65" 
ШКО, 2 | 218662 | 130.61 | 10931 99.80 | 120.35 | 138.69 
eae g | 44014 | 2205 | “yae 3.75* 106 | 125, 
cue 6 | 39.78 | “To 1042 | 965+ | 113] 164 
Residuals (Ss/Seq) 80 me = 5 60 1.55 x 
Blocks (B) EE dg c ES ar 
Response Combinationg (RC) 3 28.13 37 1.76 48 
6 14.69 19 62 05 89 7 
ooled Residuals 4,983 75.33 : 5 ah 
s = 12.25 — 11.21 
(423 gj) (423 df) 
А for | i 
and eed pooled ra a рва пн RC means arom theo 


* p < .05. 
** p 2.01. 


= af 
» disap? 
al blocks, hence all terms containing “Blocks” disaP | 


EFFECTS IN A Two-Hanp CRANKING Task 


K ап F (3/24)= .225, p > .05. However, 
tinh s Codes (St) and Runs (R) of 36 
h 11 were significant sources of variance. 
= е St effect was the result of poor perform- 
псе on the I Code (X; = 9.79 seconds), 
n. is P and D codes did not differ (X» — 
general 2 ^e 7.63). The Runs effect indicates a 
crease E actice effect with a significant de- 
first and total adjustment time between the 
8.89 qud second series of 36 stimuli (Хз = 
etween -17 seconds, respectively), but. not 
792). p the second and third series (Хз = 
(RC) К of the Response Combinations 
попав і the RC x St interaction effects were 
variance icant, Among the remaining sources of 
intera оу the Groups x Stimuli (G х St) 
(6/80) оп approached significance with F 
езе fect 199, 10<р> .05. Collectively 
results indicated that Stimulus Code, but 
€sponse Combinations, or Response 
nations in interaction with Stimulus 
» Contributed significantly to variance in 
adjustment time. 
$ oo latencies. Summaries of the analy- 
dud апіапсе for the response latencies of 
l. The right hands are also shown in Table 
in that [ for the two hands are similar 
Stimuli the Groups, Stimuli, and Groups X 
1 Sources of variance were significant, 
hi Жуз in that the Runs effect was sig- 
Senes a left hand, while the Groups ^ 
right hana interaction was significant for the 
ese effects are illustrated in Figure 1 for 
ес ча, It is apparent that the Group 
functio TéCiprocal for the two hands and a 
hang On of the dimension controlled by each 
hang Pat is, in Groups 1 and 2 the right 
Pointe tols the lateral movement of the 
ha ci Whereas in Groups 3 and 4 the left 
Sach са s the lateral movement, and, in 
associ 56, control of the lateral dimension 15 
lus е he With shorter latencies. The Stimu- 
Е arty? 35 Shown in Figure 1, is the result 
Чопау Шау long latencies on the Instruc- 
Sis, muli for both hands. This is con- 
1ч е CUR the results from the total-ad- 
Porte time analysis, as well as those ге- 
: Show, Y Cross et al. (1964). Finally, Figure 
"ец А that the Groups x Stimuli interaction 
Primarily from the fact that latencies 


Combi, 


Ode 
tota] 


w 
~ 


GROUP 1 GROUP 3 


GROUP 2 


GROUP 4 


MEAM LATENCY in SEC 


ЛШ ЕГ: 
1 Poo ut P D (Р 5 £ F b 


Fic. 1. Mean latencies, by control-to-pointer group, 
for each hand (L=Left, R=Right), with each 
Stimulus Code (I, P, D). (Arrows indicate the direc- 
tion controlled by each hand.) 


for control of the inward-outward, or Y, dimen- 
sion (Groups 1 and 2, left hand; Groups 3 and 
4, right hand) are relatively greater with the 
Instructional than with the other two codes, 
and that under the “I” code there is a greater 
difference between the latencies of the two 
hands for any given group. 


DISCUSSION 


The results with the Total-Adjustment- 
Time criterion fail to demonstrate either R-R 
or S-R-R compatibility effects. Simple R-R 
effects would have been manifested in a sig- 
nificant Response Combination effect with, 
for example, either symmetrical (C-CC or 
CC-C) or identical (C-C or CC-CC) re- 
sponse combinations yielding shorter adjust- 
ment times. Similarly, S-R-R compatibility 
effects would have resulted in a significant 
interaction between Stimulus Codes and Re- 
sponse Combinations, indicating that the op- 
timum combination of responses was a func- 
tion of the manner of encoding the input in- 
formation. The lack of such effects indicates 
that, with the present task and with the cri- 
terion of total adjustment time, neither the 
symmetry-identity nor the S-R-R ensemble 
conditions affect task performance. 

Furthermore, failure to find significant dif- 
ferences among the four groups with different 
control-display linkages does not support the 
expectation that outcome performance would 
reflect differences in population stereotypes 
with respect to C to D relations. Thus, only 
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Stimulus Codes and Runs (or practice) were 
found to affect the Total Adjustment Time 
"outcome? criterion. The former effect indi- 
cates that the Instructional code, which con- 
veys the same amount of information as the 
other two codes, results in a less compatible 
S-R ensemble than either the Pictorial or 
Digital codes. The Runs effect simply indi- 
Cates a positive practice effect over the three 
runs of 36 stimuli. 

Only one source of evidence suggests a type 
of S-R-R compatibility; the Groups x Stimu- 
lus interaction, which approached significance. 
This effect, were it more reliable, would indi- 
cate that efficiency of a particular stimulus 
code depends on the crank-to-pointer linkage. 
On the other hand, if one conceives of the 
stimuli and the display as two stimulus ele- 
ments, one might consider such an effect as 
an S-S-R form of compatibility. 

The latency data for 


с large 
in the total-adjustment- 
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response pattern results in a greater travel 
distance and longer adjustment times. This 
conclusion was supported by visual inspection 
of the continuous records which revealed little 
temporal overlap between responses of the two 
hands. It may also be true that the decoding 
of the I stimuli is more complex, since “К” 
and ^U" must be translated into “right” and 
“up” which, in turn, must be related to direc- 
tions on the display matrix. Furthermore, the 
instructions provided by the I code are mean- 
ingless unless $ maintains his starting position 
as a point of reference, This may be more 
easily accomplished by the strategy of follow- 
ing one dimension at a time. It was observed 
that S occasionally lost his reference with the 1 
code, in which Case the trial was terminated 
unless the target was attained in 15 seconds. 

Finally, information was ordered spatially 
9n the I slides in that the left-right code was 
presented as one line with the up-down code 
immediately below as a second line. Con- 
ceivably, this would induce the observed re- 
Sponse pattern, although a similar fixed order 
occurred with the Digital code in that the 
alpha code always preceded the numeric (7-5 
never 5-]), without comparable effects. 
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WAGE INEQUITY AND JOB PERFORMANCE: 


AN EXPERIMENTAL STUDY 


1. R. ANDREWS 


University of California, Berkeley 


96 students worked at 1 of 3 piece rates: equitable wage (204), underpay 


(154), or overpay (306). Half of these students worked on an inherently 
interesting task while the other halí worked on an inherently dull task. 


predicted, underpaid Ss maintained equit 


expense of work quality, whereas 
work quantity and increasing wor! 


ance difference between piece-rate groups, 
on of individual differences in previous 


1 about task difference and 1 about the 


within piece-rate groups as а functi 
Wage experience. 2 other hypotheses, 


relative effects of underpay and overpay 


supported by the data. 


This st 
баш ча 
plied to 


y provides a further test of 
(19633) theory of inequity, as ap- 
Thequit the special case of wage inequity. 
S age y d said to exist when “inputs” (such 
in Aa ucation, effort expended, etc.) are 
Such bi expected balance with “outcomes 
Bitten DN 26661788, ДОВ status, etc.). A 
Worker , meduity is said to motivate the 
adjustine, Correct the imbalance through the 
actual ‘se of inputs or outcomes, either in 
Ortion ү» or through psychological dis- 
Cory. З "ог a more precise statement of the 
жы Adams, 1963a, 1965.) 

npe i data (Adams, 1963b; Adams 
1962. ,3€n, 1964; Adams & Rosenbaum, 
theory rtowood, 1961) tend to support the 
y alee are limited in the following ways: 
Periods €ge students have been studied; work 
ISolateq үке been very short; workers were 
tasks h tom all co-workers; only two work 
£9 ris been used, and there has been no 
Шей Son across these two tasks; wage- 
throu Y dissonance has been induced only 
SPecifican, manipulation of perceived inputs, 
M said g the degree to which the worker 
May jaw 10 be qualified for the job: there 
Sibi]. Ve been some confounding by the pos- 
harder that overpaid workers were striving 
Day, 9 Protect their jobs; only the over- 
ug} Side of inequity has been studied. 
Above ! also limited by the first three points 
Petiog ^ College-student sample, short work 
› and worker isolation—the present 
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As 
y by increasing work quantity at the 


overpaid Ss maintained equity by reducing 
quality. Over and above the job-perform- 


there were pronounced differences 


inequity, were not consistently 


study attempted to go beyond earlier studies 
in the following respects: 


1. Inequity dissonance was induced through 
a manipulation of outcomes instead of through 
a manipulation of perceived inputs. 

2, Since all workers shared the expectation 
that their job would last for only 2 hours, 
there was no confounding by the possibility 
that some workers worked harder because 
they were trying to protect their job. 

3. The effects of underpay inequity were 
examined. More specifically, the experiment 
attempted to compare a small amount of 
underpay inequity against a larger amount of 
overpay inequity. 

4. The possibility of a task difference in 
the effects of wage inequity was tested. 

5. Also studied was the effect of previous 
wage experience on а worker’s reaction to 


his present wage. 


In earlier studies, perceived job inputs 
(qualifications for the job) were varied by the 
experimenter (E) while wage rate was held 
constant. In the present study, wage rate was 
varied by E while perceived job inputs were 
held constant by random assignment of 
workers to different wage groups. This modi- 
fication served three purposes: first, it tested 
the theory through a different kind of experi- 
mental manipulation; second, it eliminated 
the possibility of confounding due to differ- 
ences in feelings of job security; and third, 
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it permitted a more precise manipulation of 
underpay and overpay inequity. . 

As in Adams' later studies, this study 
employed a piecework pay system. This 
choice was dictated in part by the fact that 
underpayment on an hourly pay basis would 
have led to a self-selection of subjects (Ss), 
thus producing a biased sample. 

Under the piecework pay system, if a 
worker perceives himself as underpaid, he can 
improve his outcomes through increased quan- 
tity of production, even though added speed 
may lead to a loss in work quality. Con- 
versely, if he perceives himself as overpaid, 
he can reduce his outcomes by reducing pro- 
duction quantity, which gives him time to 
improve work quality. Therefore, under a 
piecework pay system, Hypothesis 1a can be 
stated as follows: As compared to workers 
assigned to an equitable piece rate, workers 
assigned to a lower piece rate will tend to 
produce more pieces of work but of lower 
quality, whereas workers assigned to a higher 
piece rate will tend to produce fewer pieces 
of work but of higher quality. 

Stated in the above form, the hypothesis 
does not allow for individual differences in 
how a given pay rate is perceived. Yet, it 
Seems reasonable to suspect that а worker’s 
perception of his present pay rate will be in- 
ои the pay rates he has experienced 
on previdus jobs, Therefore, as a corollary 
to Hypothesis la, Hypothesis 1b predicted 
differences within experimental groups as a 
function of Previous wage experience: Within 
experimental groups, the more that present 
Wage potential exceeds previous high wage, 
the lower the work quantity and the higher 
the work quality; the more that present wage 
potential is less than previous high wage, 
the higher the work quantity and the lower 
the work quality. 

As defined by Adams, Outcomes include 
not only pay received, but also Such factors 
as intrinsic job interest, job Status, etc. 
Moreover, outcomes are assumed to be addi- 
tive and interchangeable, so that a partial 
absence of one outcome can be balanced by 
the presence of another outcome. For ex. 
ample, a partial absence of рау can be bal- 
anced by high intrinsic job interest. From this 


line of thought can be derived Hypothesis 2: 
Wage inequity will have more of an effect 
upon job performance and job attitudes when 
the task is dull than when the task is in- 
tly interesting. 

kx states that it is probable that the 
thresholds for inequity are different in cases 
of under- and overcompensation. Like Jacques 
(1961), Adams believes that workers are more 
sensitive to undercompensation than to od 
compensation. This idea was reflected in e 
pothesis 3: A small underpay inequity wi 
affect job performance as much as or more 
than a larger overpay inequity. 


METHOD 


There were 96 university students, hired through 
the student placement office, who were aure 
randomly to one of six conditions of two EET 

(a) Interviewing: Low pay rate, 156 per ai 
(n= 16); Equitable rate, 20¢ per piece (n = 
High pay rate, 30¢ per piece (n= 16). T. 

(b) Data Checking: Low pay rate, 154 per Бе) 
(n= 16); Equitable rate, 204 per piece (л = 
High pay rate, 304 per piece (z — 16). T 

A comparison of these six groups on such Lr 
аз age, year in school, and previous wages car 
showed no significant differences. 


Procedure 


: o 
Through pretesting, both tasks were aajusted 
an average production of nine pieces per the 
Then, by dividing nine pieces of work д 
average hourly pay rates recommended by Pis 
Ss ($1.78 for interviewing and $1.79 for data Core: 
ing), the equitable pay rate was set at 204 per P per 
The overpay rate was set arbitrarily at A a 
piece and the underpay rate was set тышаш. 
156 per piece. This asymmetric change е 
20¢ equitable rate was in keeping with the rpay 
hypothesis which stated that a small unde КЕ 
inequity would have an effect equal to, or gre 
than, a larger overpay inequity. er- 
That these differences in wage potential were P in 
ceived as intended was confirmed by difference’ о, 
the size of the discrepancy between “worker pA 
mendations for an appropriate hourly pay rate see 
“the amount of money which had already se 
earned.” On the average, the recommended ant 
Day rate exceeded pay already earned by $0.13 a3 
hour in the case of the 15¢ piece-rate group, o, 
compared to $0.05 an hour in the case of the da 
piece-rate group. For the 306 piece-rate group; ш 
Tecommended hourly pay rate was $0.69 an ho 
less than the Pay already earned. es 
Over and above the between-group differen" 
Predicted by Hypothesis 1a, Hypothesis 1b РЕ 
dicted within-group differences as a function © 
Previous wage experience. For the total sample, t 
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23 highes В 
eee paid persons earned $2.25 or more per 
Or less Ше the 25 lowest paid persons earned $1.55 
ranged i hour, leaving a middle group which 
Previous was $1.60 to $220 per hour. These three 
ers Уй ee чы were used to divide work- 
i each of the piece- E ур» 
ч й piece-rate groups as те 
3 plis Hypothesis 1b. 
had i ed by the second hypothesis, one task 
other aisle St greater inherent interest than the 
9n cam - For this purpose, interviewing students 
While RS was selected as the interesting task 
аз the dul ing transcribed numbers was selected 
experimental So" As evaluated by both pretest and 


average rats 
Se rating of about 6 on a 7-point scale, while 


job 


h 
th 


each employee worked for only 2 
* two ho: no expectation for employment beyond 
urs; each employee was given 30 pieces 

the instruction *. . . to work on 
hours"; by pretesting and adjusting 
i the two tasks were equilibrated for the 
‘Pecified Кыш of pieces completed within а 
ata, the me; in pretesting айй in the experimental 
the two Performance variance was about equal for 
identica]; asks; piece rates paid for the jobs were 
сма 20186 instructions about work quantity 
ар1оусе У Were omitted deliberately; only male 
SOlation ^, Were hired; each employee worked in 
Presented Be Other employees; both tasks were 

"Or each the guise of legitimate jobs. 

Went у; „ОЁ the two tasks there were two de- 
Work q Variables, work quantity and work quality. 


"Quantity 
that Чапу data were entered in raw score form, 


? t 
Pleteq Pe ш number of work pieces COM- 
s tasks Ours, This was possible because the 
0 Were comparable in average rate 0 


Uctio: 
ОЕ the p> Production variance, and in the shape 


е fn 

Кт т Дае (symmetric and some- 
Кау р, data, on the other hand, 
T erent for the two tasks and, therefore, 
Was tical Converted to standard score form for 
9. defin Comparisons. Interviewer work quality 
Pe „as the average number of words 
ber ү with Merview—a measure which correlated 
Vor erviey the average number of ideas recorded 
the a recordi The higher the average number of 
tuy ta Che d the higher the work quality. For 
the ber of ckers, work quality was defined as the 
in a transcription errors missed divided by 
meee of errors which had been planted 
ages which the worker said he had 
S8 hi i ler the proportion of errors 

Sher the work quality. 


were 


As T" RESULTS 
Dor, i dicteq by Hypothesis 1a and Hy- 
› Quantity of output was negatively 


TABLE 1 


Quantity oF WORK AS A FUNCTION OF ASSIGNED 
Prece КАТЕ AND PREVIOUS WAGE EXPERIENCE 


Previous high | 254 per | 206 per | 306 per | Row 
wage per hour |ç ре. piece pisce average 
л = 32) | (п = 32) | (п = 32) | 2verase 

$2.25 ог тоге 

(n = 25) 23.7 18.2 19.6 21.0 
$1.60 to $2.20 

(n = 46 22.2 20.3 17.0 20.0 
$1.55 or less 

(n = 25) 16.7 15.9 15.1 16.0 

Columnaverage| 21.1 18.9 17.7 19.2 


related to assigned piece rate and positively 
related to previous high wage per hour (Table 
1). The mean difference between the 15¢ 
and 30¢ piece-rate groups was significant at 
the .02 level (t = 2.56), while the mean dif- 
ference between the $2.25-or-more and the 
$1.55-or-less groups was significant at the 
01 level (¢ = 2.91). 

Also as predicted, quality of work was 
positively related to assigned piece rate and 
negatively related to previous high wage per 
hour (Table 2). The mean difference between 
the 15¢ and 30¢ piece-rate groups produced 
a t value of 1.83, not significant with a two- 
tailed test. If one accepts a one-tailed test on 
the grounds that direction of effect was pre- 
dicted, then this £ value was significant at 
the .05 level. The mean difference between the 
$2.25-or-more and the $1.55-or-less groups 
was significant at the .05 level (¢ = 2.33). 

When work quality and quantity are con- 
sidered simultaneously, persons who feel over- 
paid should produce fewer pieces of higher 
quality work—while those who feel under- 
paid should produce more pieces of lower 
quality work. The proportion of workers who 


TABLE 2 


or WORK AS A FUNCTION OF ASSIGNED PIECE 


QUALITY д 
RATE AND PREVIOUS WaGE EXPERIENCE 
" 154 per | 20¢ per | 30¢ per " 
Previous high piece piece тесе Row 
жаке per hour |(g—32) | (п = 32) | (n = 32) | verase 
Sas orm | озо | -omi | 4015 | оло 
.20 
son —олз | -032 | 4020 | —ол2 
less 
ae 9125) 0.01 | +0.57 +0.62 +0.38 
—0.16 —0.16 +0.30 0.00 


Column average 
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fell in the former category—work quantity 
below the total sample median and work 
quality above the total sample median—is 
shown in Table 3. The proportion of workers 
who fell in the latter category—work quantity 
above the total sample median and work 
quality below the total sample median—is 
shown in Table 4. In both tables the in- 
fluence of piece rate and the influence of 
previous high wage are readily apparent. For 
example, if а — worker's previous high wage 
was $1.55 or less and his present piece rate 
was 30¢, then there was a 75% chance that 
he would turn in fewer pieces of higher 
quality work and a 13% chance that he 
would do the reverse. The probabilities were 
strikingly different for a person whose previ- 
ous high wage was $2.25 or more and whose 
present piece rate was 15¢; for such a worker 
there was a 10% chance that he would turn 
in fewer pieces of high quality work and a 
607% chance that he would turn in many 
pieces of lower quality work, 

According to t 


the data did not sup- 
port the hypothesis, On the other hand, two 
Pleces of evidence did Provide some en- 
couragement for the task-difference hypoth- 
esis, First, the correlation between “work 
quantity” and “the size of the discrepancy 


TABLE 3 


CHANCE 1N 100 THAT Work Quantity Was Керт Low 
WHILE Work Quarry Was INCREASED 


Previous high Assigned | 
wage per hour | Piece rate | Chance in 100 
$2.25 or more (л = 25) j 15¢ | 10 
20€ 0 
30€ 40 
$1.60-$2.20 (и = 46) | — зу 8 
20€ 21 
| 304 36 
$1.55 or less (n = 25) 15 44 
20€ 75 
30€ 15 
саана ылы сс iw 


TABLE 4 
CHANCE IN 100 THAT WORK Quantity Was INCREASED 
WHILE Work QuALITY Was SACRIFICED 


GVISHE liga’ | TN А 
Previous high | Assigned (hance it 100 
wage per hour | piece rate 

$2.25 or more (n = 25) | 156 60 

| 20е 40 
30e 20 
| 

$1.60 $2.20 (n = 46) | 156 40 

| 20€ 58 
| 306 20 
$1.55 or less (n = 25) 15¢ 0 
20¢ 13 
30¢ 13 
| 


between present wage potential (9.5 pen 
the assigned piece rate) and previous hi8 
wage per hour" was —.54 for the dat 
checkers but only —.32 for the interviewer? 
The comparable correlations for work quali 
Were .35 for the data checkers but only а g 
for the interviewers, Though not геа» 
statistical Significance, these differences |” 
correlation size were both in the direct, 
predicted. A second kind of support for p 
hypothesis stems from the way job-attitU 
Scores (on a postwork questionnaire) aiit 
аз a function of assigned piece rate. Amore 
the data checkers there was a systema" 
Change across piece-rate groups—the high 
the piece rate, the more favorable the r 
attitude on five out of six scales. In contra? 
job attitudes among interviewers remain? 
fairly constant from one piece-rate groUP о 
another. Among interviewers, for examp oj 
the mean difference between the 15¢ and 5 id 
plece-rate groups on the underpaid /overP?, 
scale was not Significant at the .05 lev®’ 
among data checkers, on the other har 
this difference Was significant at the 
level. ар? 
According to the third hypothesis, Je 
performance differences between the 156 t 
20¢ groups should be equal to or great n 
than the performance differences betwe?, 
the 20¢ and 30¢ groups. As shown by ay 
column averages in Table 1, work-quanl s, 
data were Consistent with this hypothes”’ 
the mean difference for the 15¢/20¢ © 
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parison was slightly larger than the mean dif- 
ference for the 20¢/30¢ comparison, 2.2 as 
Compared to 1.2 pieces of work. Work-quality 
data, on the other hand, were not consistent 
Fi the third hypothesis; the mean dif- 
aimi for the 15¢/20¢ comparison was 0.00 
fag Ew to a mean difference of 0.46 
Feach е 206/304 comparison. Though not 
levi ng statistical significance until the .10 

©, the direction of this difference in mean 


difi = ; е 
erences was inconsistent with the hy- 
Pothesis, 


DISCUSSION 


"s above results are consistent with 
rom ee which showed that dissonance 
tem) радови (опа piecework pay sys- 
and beg: lead to à reduction in work quantity 
result increase in work quality. The above 
ing, 5 айй to previous studies in the follow- 
5 Ways: 
нез е earlier studies which eec 
job pan y the manipulation of paraw 
баан S (qualifications for the job) is 
manipu] MR produced inequity by the 
assumed ion of assigned piece rate. It = 
ically t5 that workers would check period- 
ing. See how much money they were earn- 
s |, nie Who perceived their earning rate 
"at ie Would be tempted to increase their 
haq & Production even though work quality 
9 be sacrificed and vice versa for those 
Some ‘natal they were earning too much. 
from ee for this interpretation follows 
tendeq ne fact that 30¢-per-piece ipe 
Seconq to do fewer pieces of work in their 
tendeq hour, while 15¢-per-piece workers 
© to do more pieces of work in their 
Nour, 
discussions with workers re- 
lo "at another fairly common approach 
Чен Job was the establishment of a PTO- 


“хапу quota before work was begun. For 
Wage” ©, if a worker had a high previous 
4 2 Kei $2.00 per hour, then assignment to 
Mota Per-piece rate would lead to а work 
Worka. 10 pieces per hour. That same 

i te would 


е . 
set. | assigned to a 30¢-per-piece ra 
адај, 1404 of about 7 pieces per hour, once 


ain р Р 
Б hon; A д 
his 10ріпо to earn at a rate consistent with 


evi К «tent 
ous wage experience. To the exte 


г 


that such а worker could maintain his selí- 
imposed rate of production, dissonance could 
have been avoided. For these workers, it 
could be argued that Adams' dissonance 
model was less appropriate than a cognitive 
consistency model which does not postulate 
dissonance, for example, Sampson's (1963) 
expectancy congruence model. This change 
in explanation, however, does not negate 
Adams! basic point, namely, that workers 
adapt their productive effort to maximize 
equity rather than total earnings. 

In both of the above reaction patterns 
there was an adjustment in rate of output 
which reduced or prevented wage inequity. 
But not all persons responded to a perceived 
inequity by adjusting rate of output. For 
example, one 15¢-per-page data checker said 
that he just could not believe that it was 
real—that he must have misheard the in- 
structions. He also said that at times he felt 
like going through the pages and changing 
many of the numbers. In spite of these mis- 
givings, he turned in good quality work. 
Several of the underpaid workers rationalized 
their low earning rate by saying that they 
just were not well suited to the job. On the 
opposite side of the equity ledger, some of 
the overpaid workers rationalized their high 
earnings by saying that they were unusually 
skillful at this kind of work. Of these workers, 
several cited previous job experience which, 
as they saw it, developed the required skills. 

Not included in any of the above reaction 
patterns (or in the results data) were three 
15¢-per-piece workers who quit the job after 
30 or 40 minutes, stating that this just was 
not their kind of work. No workers left their 
jobs in the 20¢- and 30¢-per-piece groups. 
^ Also not included in the above reaction pat- 
terns were three 30¢-per-piece data checkers 
who tried to reduce overpay inequity by re- 
porting fewer pages completed than they 
had actually done. Lastly, there were some 
workers who claimed that they were unaware 
of how much money they were earning. They 
said that they just did their jobs and did 
not watch the clock or count the pieces of 
work completed. 

2. Whereas earlier studies considered only 
the overpayment side of inequity, the present 
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study also examined the effects of under- 
payment dissonance. As expected, the average 
work quantity was greater for the 15¢-per- 
piece workers (21.1) than for the 20¢-per- 
piece workers (18.9). However, the expected 
trend did not hold for work quality where 
there was no difference between the 15¢- and 
20¢-per-piece groups. Several explanations for 
this lack of difference are possible: first, the 
5¢-per-piece differential between the 15¢ and 
20¢ groups was too small; second, increased 
speed on the monotonous data-checking task 
kept workers more alert with the result that 
work quality did not suffer from a slight 
underpayment; third, possible confounding 
by a change in personnel in the student 
placement office—an interpretation fostered 
by the fact that the expected trend was very 
much intact before the addition of the last 
16 Ss, workers who were hired after the 
personnel change at the placement office. In 
brief, E believes that the inconsistency of 
work-quality data should not be taken as 
evidence against the hypothesis. A subsequent 
study, using 104 рег piece as the unfairly 
low wage and 254 per piece as the equitable 
rate, found that the underpaid Ss not only 
produced more pieces of work (interviews), 
but did so by a statistically significant reduc- 


tion in work quality (Lawler & O'Gara, 
1966). 


terms of objective reality, 

Worth noting in the 
ences is the fact that th 
$2.25-or-more Broup was o 
ance of the $1.60- 
$2.20 group— while the erformance of the 
$1.55-or-less group was markedly different, 
This fact might mean that there was a ceiling 
on worker pay expectations for a campus 
job, and once a worker’s Previous Wage ex- 
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perience was high enough to bring him ир to 
that limit, further increases in previous high 
wage had no additional effect. Я 

From an applied viewpoint the within- 
piece-rate-group differences suggest that prê- 
vious wage history should be considered in 
hiring new employees. Other things equal 
an applicant whose previous high wage was 
less than the wage for the present job might 
be a better risk than an applicant whos? 
previous high wage exceeded the wage for the 
present job. 


Limitations in Generality 


As always there are several considerations 
which limit the generality of this study lt 
the related studies cited in this report. First 
there is the time factor: that which is ber 
for a 2-hour work period might not be NE 
for longer work periods. Second, that which ; 
true for a college-student population is du 
necessarily true for other populations. Amons 
unskilled workers, for example, social clas 
differences in belief value systems might le? 
io a different response to overpay inequity Ч 
Ог, in a management population, dedication 
achievement for its own sake might counterae, 
the effects of underpay inequity. Third, in а 
the studies reported, each worker was isolate” 
from all other workers, This fact is a рап a 
cap when you try to generalize to the mor 
typical work situation where workers are Ж 
volved in one or more groups. Until such ti? 
as the above considerations have been ш? 
by additional research, caution must be al 
ercised in drawing inferences for indust"! 
Practice. The experimental data tell only p 
а perceived wage inequity does influence t 
job performance of college students who 87 
hired for short-term jobs which allow them 
Work in isolation from other workers. 
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VISUAL FACTORS AFFECTING TRANSFER OF 
TRAINING FROM A SIMULATED TO A 
REAL CONTROL SITUATION 


M. HAMMERTON axo А. Н. TICKNER 


Medical Research Council, Applied Psychology Research Unit, Cambridge, England 


3 experimental groups, each of 12 Ss, were trained to control a trolley moving 
on a miniature railway so as to carry out an acquisition task. They were 


trained using (a) a TV display 
scaled photographic transparency, 
(d) plain CRT. A control group 
These conditions produced mark 
initially and with a savings meas 
were highly significant (p € 01) 


‚ (b) a cathode ray tube (CRT) with correctly 

(c) CRT with out-of-scale transparency, and 
oi 12 Ss trained on the real trolley ab initio. 
edly different transfer (a>b>e>d) both 
ure. In 6 of 12 comparisons made, differences 
3 in 4 they were significant (p < 05) and in 2 


not significant. A further experimental group (12 Ss), using a TV display, and 


trained to carry out a pursuit t 
are: ideal simulation must ta 
texture and (b) accurate dept 
compounding 


A previous study (Hammerton, 1963) re- 
ported an investigation devised to examine 
transfer of training from simulated to real 
control tasks, both being relatively simple and 
dynamically identical. The real situation in 
that investigation was an acquisition task in- 
volving the control of а trolley moving upon 
a miniature railway at a distance from the 
subject (S) of 60 yards. The kinematically 
identical simulation display was presented on 
a cathode ray tube (CRT). It was then found 
that the simulator training. produced very 
poor first trial transfer, though the recovery 
of skill was Very rapid. It was suggested that 
these findings might be an instance of stimulus 
compounding in the transfer situation, which 
is known to give such an effect (Estes, 1959), 

If this were 50, it would be predicted that 
а simulator display which included a good 
deal of the general appearance, background, 
and texture of the real situation would give 
markedly better transfer than the plain CRT 
previously used. This condition could be 
closely approximated by using, as the train- 
ing “simulator” display, the monitor screen 
of a closed-circuit television (TV) apparatus. 
However, should such a device give the very 
good transfer expected, the hypothesis would 
not stand proved; for another factor could be 
involved: the effects of visual scaling of depth 
and speed. For in the real situation there is 


ask, also showed very good transfer, 
ke account of both ( 
h scaling. Absence of 
; absence of (b) leads to misestimations, 


16 


Conclusions 
а) adequate. background 
(a) can produce stimulus 


present all the rich variety of depth and speed 
cues which are normally available; the for 
display gives a large number of these, a 
example, overlap, convergence, texture, Lagen 
objects, etc. (see Gibson, 1950), though 1 
perfectly; whereas all the cues provided A 
a CRT relate to blips of light very close E 
S, and moving at a few centimeters per се 
ond. In order to examine the importance " 
this factor, it was necessary to compare p 
fer to the real situation from two display” 
both of which gave a lot of “real world е 
ture, but of which one was markedly out 
scale. ye 
The experiments reported here were the se 
fore devised to investigate the effect of pon 
factors upon transfer. The real situation W n 
identical with that described in Hammer | 
(1963). Tn the first experiment a TV зу 
Was used for training: in the second and ee 
a CRT was used, modified by covering : 
Screen with photographic transparencies ae 
two different magnifications in the two € 
periments. rie 
In considering the results of these expe E 
ments it was necessary to consider the ро 
sibility that, in the conditions where ассша 4 
background details were supplied, 55 up 
merely learned to respond to particular fe 
tures of that background. For example, i 
Ss learned such things as “centralize cont! 
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ү E trolley passes such-and-such a 
feeb cert he first experiment was there- 
ition e i pursuit task. In this con- 
Snee m earning would not be possible 
Would be particular background features 
larget ааа. with particular trolley- 
much bn iin and, if it were important, 
ransfer would be expected. 


METHOD 


Subjects, T 
(data 5. Th 
Contro] 


incor £ control group for Experiments 1-3 
tly from Hammerton, 1963), the 
perimental or Experiment 4, and cach of the 
"tings, whos groups consisted of 12 Royal Naval 
APbaraing с, SS ranged from 18 to 26 years. 

S was 8 5 and task. The real object controlled by 
Straight Je small wheeled trolley running along а 
The « Sara of railway, normal to his line of sight. 
Sabin 60 the experimenter (E) sat in a control 
узек iiM from the track. The S used a thumb 
mear ve CHINE] the movements of the trolley, the 
fom in комн of which was proportional apart 
is s mein lag, to the deflection of the stick. The 
NE Stick Was approximately 300 seconds", that 
Velocity cp deflection of 1 centimeter produced à 

the trolley of 300 centimeters per second. 
ith by means of a dekatron timer, which 
=3, s Dress button, and which, in Esperi- 
Temained poer when the center of {һе trolley 
was lat zon continuously for 2 seconds within а 
to S 6 inches е of the track. The length of this zone 
bi A Ya E a its size and position were indicated 
Chin ite-painted metal target, which appeared 


W| H e М 
|a * Nea When the dekatron w 
es | i €n the dekatron stoppe 
la] * trolley was an upright strip of Black 


ta > Wi à t 
по "pies strip was in line with the white 
"d always Ej Was within the target zone. The 

Ove үр the ri deos each run from a position 
ang 5 the trolle, t of the target. The S's task was to 
9n to icep ma to the target as rapidly a5 possible, 
Кш тип t there until the target fell. His score 
pd in d Was the time shown on the dekatron. 

ш o 2-second “holding time.” 

a py 20 as Gree sessions in Experiment 1, Ss (re- 
lust Screen Thon A) observed this real situation on 
vy Slc osed he TV equipment used was à Pye im- 
K 31> ^ Circuit set, using a type 2026 camera, 
s Thi, gonttol unit, and a type 2870 monitor 
trip ch ice a 405 line picture on a 11.5-inch X 
eye besiq еп. The camera was mounted on а 
Ms Sint of Pie cabin at the level of S’s head. (The 
^" wt "lewpoi * picture was thus 1 yard to the left 
the (ated us in transfer trials.) The screen was 
Ла qi Wer at Ss eve, the angular movements of 
Derim * approximately correct. | , 
vend. on Td 2 and 3 the real situation W35 
Wag дем th а CRT, so that, for a given contro 
Was Ideni) angular display movement at S's eye 
її the simulated and real cases- This 


Р al 

асы 
Ved е =й 
у picking up the trolley's move 


ments directly. Аз the trolley moved, it operated a 
potentiometer, which controlled the X-plane voltage 
of one output of a double-gun CRT. The other out- 
put was fixed as a vertical line, and the voltages 
were so arranged that the "trolley" spot coincided 
with the fixed line when the trolley was on target. 
The fixed line thus represented the target; it was 
made to appear and disappear as the target itself 
did. By these means the linear movements of the 
spot upon the CRT were in strict correspondence 
with those of the trolley itself, and no question of 
error in representation arose. The distance from 
starting point to target on the screen was 50 milli- 
meters. At S’s eye this subtended the same angle as 
the 6-yard run at 60-yard range. Thus, whatever 
control movement S made, the angular display move- 
ment was identical in both real and simulated situa- 
tions. 

During simulation sessions, the CRT was mounted 
(as was the TV monitor during Experiment 1) on 
a frame outside the control cabin, with its face 
against the window through which S normally 
looked, the rest of the window being blanked out. 

The face of the CRT was covered by a photo- 
graphic transparency of the view which S would 
have in the real situation. In Experiment 2 this was 
exactly to scale, so that the spots of light on the 
CRT appeared upon the photograph precisely where 
the trolley and target would appear in the transfer 
situation. In Experiment 3, however, the trans- 
parency was enlarged by a factor of 2, so that, 
though angularly correct, the spots of light appeared 
to refer to smaller movements against a very much 
closer background. The groups taking part in these 
experiments are referred to as Groups B and C, 


respectively. 
In Experimen 


altered. A 12-yar 
the existing one and ( 


t 4 the apparatus and task were 
d length of rail was laid parallel to 
from S's viewpoint) behind it. 
Along this new rail ran a trolley carrying a white- 
painted metal target 6-inches square. This trolley 
moved back and forth along its rail at а uniform 
velocity of 5 feet per second. (This was approxi- 
mately half the maximum velocity attainable by the 
trolley under S’s control.) Micro-switches at each 
end of the track reversed the movements of the target 
when it came to them. An angled strip of metal was 
attached to S's trolley so that it interposed between 
a lamp and а photocell which were on the target 
trolley when S's trolley was оп target.” A short- 
range radio device was used to operate a relay in the 
scoring equipment when this happened. 

The S's task was to bring his trolley from the 
end of the target’s run, to align it with the 


pposite | s 
duh and to keep it aligned for 2 seconds con- 
tinuously. When this had been done, the target 

i n ended, and S was told his score. 


s ned, the ru 
үйү arid target were then returned to the ends 
; from which they had started, and 


opposite to those аш 
Т esl, Үй could begin (ie. runs started. from 


alternate ends of the target’s range). 


The group ta 


king part in this experiment is re- 
ferred to as Group X. 
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TABLE 1 


TRANSFER MEASURES OBTAINED UNDER THE 
SEVERAL EXPERIMENTAL CONDITIONS 


Experimental | Training condition € c 
group | | 

д, ту | оов | 1.00 

B CRT with correct 
| phototransparency | 0.71 | 0.92 

C CRT with x 2 

transparency 0.39 | 0.85 
р Plain CRT 0.24 | 0.77 
xX TV of moving target | 0.88 | 0.91 
Procedure. This was identical in all the experi- 


ments. The Ss were shown the apparatus, and the 
nature of the task and method of scoring were care- 
fully explained to them. The E demonstrated the 
task once, and trials began. 

The Ss in each experimental Eroup carried out 10 
trials each day for 3 days using the TV monitor, or 
CRT with transparencies. 

They were told the time they had taken im- 
; they thus had 30 trials 
On the fourth day the 
ed, and Ss were given 
n, again with knowledge 
trol group were similarly 
in the real situation for 


RrsurTs 1 


Sav- 
g of 


a 
training which is retai 


posttransfer situation ( 
The savings measur 


ing the Mann-Whitney 


gel, 1956) it was found 


the second half of 
cases). It was foun 


1 The authors wish to thank В: 


e a П А Һат for advice 
on statistical techniques, 


| 


control group for Experiments 1-3 did no 
differ reliably from one another, at the E 
level, after their thirteenth trial. If then ү 
any of experimental Groups A, B, and i 
successive group mean scores do not diffe 
reliably (again at the 595 level) after the б 
transfer trial, the savings measure « was 
fined as: 


The control group of Experiment 4 6. 
quired 22 trials to reach a stable performan 
level. (Their task being a more difficult pu 
they naturally took longer to master it.) 
Group X, therefore, с was defined as 


1 
D J А rna | 
The “first-shot” measure used was inte 
to each group. This was e, defined as 


= 
= Чч 


where F is the performance on 3 
training trial, L on the last, and T B ай 
performance on the first transfer trial. such he 
internal measure could be deceptive ! up: 
stable performances of the experimental gre ol 
differed significantly from those of the co? ot 
group. As noted above, however, this He a 
the case here. The values of є and о fot LP 
of the experimental groups are laid Grou? 
Table 1. (The data for the fourth row, 3.) 
D, are incorporated from Hammerton, вай? 

The entries in the e column are the an ей 
of the several Ss’ e scores, The student 


TABLE 2 
SIGNIFICANCE oF DIFFERENCES 


N 


p) nETWEP, 
GROUPS ON Tr 2 Measures or TRAN | 
Groups “Virst-shot” Saving? | 
compared measure (a) 
(9 | 
5 | 
AvsB <.05 em 
AvsC <01 < v1 
AvsD <.01 gi | 
Вус <.05 PA 
B vs р <01 «0 | 
CvsD p <.0- 
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rang Р? 
et ар. (Winer, 1962) was used to 
tween ma significance of the differences be- 
nificances hs alues of Groups A-D. The sig- 
task of ion shown in Table 2. Since the 
the other ima X was different from that of 
this Мон Е аср to include their results in 
valid, That pe comparison would hardly be 
оь bs the values are very high will, 
Upon the gn As the с values are based 
ай to be р pooled means, significances 
у fixing iier indirectly. This was done 
each S s posttransfer stability point for 
1956) (г Ше one sample runs test (Siegel, 
differen using the above method to test for 
ces in л and hence v. 


Discussion 


It 
ope ВА recalled that there are three 
Ivolving th ctors concerned in any situation 
lése аге e transfer of a visual motor skill. 
display, 4 the system dynamics, the visual 
isp ay, ^; the other sensory features of the 
ements ee kinesthetic and auditory 
e second ur studies have been confined to 
obtained n these. The good transfer values 
Merely co y Group X strongly indicate that 
not а PO ы details of the display Were 
a confounding factor in our re- 
baden. taken to ensure that the 
tin то and transfer situations did 
than’ accou heir dynamics, and it is difficult 
'S was I of other experiments in which 
jn example D Even in those where it was, 
e M Dougherty, Houston, and Nick- 
aesthetic here was great variation in the 
“ansfer sit Properties of the training ап 
ex ANS qaos Thus the present series 
p minatio ents must stand by itself as an 
simula of the visual factors in transfer 

ated to real control situations: 


Severa] 
Not а; 
ic diffe 
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Р To attempt a numerical comparison of the 
importance of the various factors is not at 
present possible. It is possible, however, to 
assert that really high first-shot transfer re- 
quires (а) adequate depth-scaling cues, and 
(b) adequate background detail. It seems 
demonstrated that absence of (b) can, in 
fact, produce stimulus compounding in the 
transfer situations. 

The practical significance of these findings 
clearly depends upon extrapsychological (espe- 
cially economic) considerations. It seems that, 
when the initial transfer is poor, even when 
markedly s0, the effect is transient and re- 
covery is rapid. Therefore, if the requirement 
of a simulator is that it should save training 
time, а relatively simple visual display can 
be quite sufficient. The desirability of good 
initial transfer must be weighed against the 
increasing cost of realistic simulation. 
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tor variables which, on cross- 
d managers who Were over- and underpre- 
i These moderator tests were 


tion sample 55 managers 
ssed as unpredictable." The Point-biserial correlation 


з (above or below the criterion median) and 
5 .73 as compared with 


-65 for all managers in the sample. More- 
Over, the degree of Overlap on th 


€ actual criterion scale between managers 
or "low? was teduced from 38% to 28% by using the 
that these results provide further confirming 


r enhancing the magnitude 


; ssity for 
incontrovertible Proof of the necessity Ж 
changes in methodology. Thus, Ghiselli’s 


h JS ces 
ction research: view is probably one of the major influen 
Hull’s Aptitude Testing in 1928 


and leading to recent methodological assaults js 
the problem of low validity coefficients 
П argued that lest and selection research, del 
› correspond- Attempts to update the theoretical waa 
underlying test validation and selection 


У ject the 
4 search have emphasized the need to rejec i 
ng efficiencies overs; i 


1 
model suggested originally by Guetzkow wee 
Forehand (1961) and modified by Dunne 


i Е р, akes 
of .50 a distinct rarity, "арты (1963a, 1966) is shown in Figure 1. It tà 


try Laurent of the Standard Oil 
of New Je 
ation for the managers ta 
ard's Early 


еп years 


lctive accuracy provide complex interactions 


ect 
which тау occur betwe 
Predictor combinations, M 
5) of individuals, differ? 
and the consequences |. 
relative to the goals of the org 
е, 1963a, р. 318]. 


Predictors and Various 
à doctoral dis. ferent. groups (or type 
е School of the behaviors on the job, 
by Hobert under Dun- shese behaviors 
are deeply gratefu] ation [Dunnett 


H for i er 
e test and стиш, This new model explicitly defines the 4" 
king part in Stange Vening variables, that is, the individuals, тес 
ehaviors, and Situations, which can af ri- 
the relationship between predictors and € 
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Predictors (Individual 


. Individuals 
Difference Mea lr 


3 13 


Fi. 1. A model for test validation and selection research (D 


teria 
the caead of ignoring such factors, as in 
(0 criteria validation model linking predictors 
the Bun à simple index of relationship, 
Plies thay Forehand -Dimnette model im- 
eterminir prediction can be enhanced by 
Operate hy how these intervening variables 
that valid. Sven situations. Thus it dictates 
ecific gr studies need to become more 
üni y defining and taking account of 
nt ar conditions appropriate for dif- 
behay; Situations, persons, and specific 
accou ral outcomes. Thus, in order to take 
Predictor of complex interactions between 
wi tere and organizational consequences, 
Bencoys Sary to identify relatively homo- 
Job pa Subsets of predictors, individuals, 
| с aviors, and situations. For example, 
ides; zoe ecient developed by Primoff (1955) 
Wb en ‘Subgroups of jobs based on careful 
"dictar and emphasizes the differential 
iselli "ity of job activities. Balma, 
» McCormick, Primoff, and Griffin 
к recognized the varying predict- 
rect Job activities їп their discussion 
Jevera OE synthetic validity. 
i i ntif Investigators have suggested ; 
пауз 2198 these homogeneous subsets © 
тон 5 or “types.” Summarizing а variety 
Gai Ods of assessing profile similarity, 
and Lee (1955) and Cronbach and 
va) conclude that these indexes are 
e ariants of the formula for the linear 
etween two points in n-dimensional 


ways 


Behaviors 


а ig ——3À > йыр" 


7 Consequences (Related 
Situations 
to Organizational Goals) 


1 ш 


unnette, 1966). 


space. Lykken ( 1956) has taken issue with 
the psychological meaning of similarity de- 
fined in terms of linear distance, and has 
proposed a method of actuarial pattern 
analysis requiring no assumptions concerning 
the form of the distribution and defining 
similarity in psychological terms. He ac- 
complishes this by classifying subjects (Ss) 
together into cells on the basis of similar test 
scores, and then investigating the criterial 
outcomes for persons in each cell. Toops’ 
(1959) use of biographical and test simi- 
larities for developing “ulstriths” is essentially 
the same as Lykken’s approach, and he also 
advocates developing different prediction 
equations for each subgroup. 

Another approach to the definition of 
“types” of individuals has involved the dis- 
covery and use of moderator variables. Al- 
though investigators have given different 
o the variables they develop, for ex- 
ample, “population control variable” (Gay- 
lord & Carroll, 1948), “modifier variable” 
(Grooms & Endler, 1960), “referent vari- 
able” (Toops, 1948, 1959), “predictability 
variable” (Ghiselli, 1956, 1960a, 1960b), and 
“moderator variable” (Banas, 1964; Saun- 
ders, 1956), these variables have in common 
the implication that homogeneous subgroups 
of individuals may be isolated which will 
show different patterns of validity. 

The challenge to update their models and 
techniques thus is being met by those en- 


names t 
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gaged in test and selection research. In fact, 
the very number of new techniques proposed 
for handling the various factors in the pre- 
diction equation has created a new need. 
This new need is for research devoted to 
theoretical questions, to comparing the vari- 
ous techniques under a variety of conditions, 
and to refining the new techniques and ex- 
plaining more precisely how they work. Such 
research must be undertaken now to lay the 
groundwork, by accumulating a body oí 
evidence, for a future synthesis of these tech- 
niques into a workable theoretical model. 

It was in response to this need that the 
present study, concerning the use of modera- 
tor variables in identifying homogeneous sub- 


groups of more and less predictable individ- 
uals was undertaken. 


RELATED RESEARCH AND STATEMENT 
OF THE PROBLEM 


variables, 


п à predictor 
аге especially appropriate, 


m are selected Which Correlate most 
Ighly with the absolute differences between 


1956, 1960a, 1960b, 1963); 

technique" in which item res 
related with the difference 
and predicted criterion me 
resulting scales are used as 
multiple-regression equation (England 1960: 
Neidt & Malloy, 1954): (c) Assessment of 
intraindividual variability, where variability 
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among subscores on a test is used to de- 
termine more and less predictable subgroups 
of individuals (Berdie, 1961); and (d) 
Statistical infrequency of response and/or 
response inconsistency approaches which have 
been used to develop verification, validity, of 
carelessness moderator scales for the SVIB 
(Fillbeck & Callis, 1961), the Kuder Per 
sonal Preference Record (Kuder, 1956), the 
Minnesota Vocational Interest. Inventory 
(Campbell & Trockman, 1963), and the 
MMPI (Meehl & Hathaway, 1946). в 

Another approach suggested by Banas 5 
to “develop a moderator by item analys!s 
in which the algebraic differences betwee” 
the standard predictor scores and the stand- 
ard criterion scores are used to select the 
items.” Implicit in taking an algebraic 
difference is a notion of the importance 
of direction of prediction, that is, ove 
prediction and underprediction. Whereas the 
absolute-difference technique divides a samp! 
into two groups, “hits” and “misses,” or 4 
Ghiselli calls them “predictable” and “W 
predictable," taking an algebraic difference 
results in three categories: "predictable; 
“overpredicted,” and “underpredicted.” Ove" 
Prediction and underprediction have practica 
meaning both to the institutional decisio? 
maker and to the individual for whom f 
Prediction is to be made. Instead of ей 
bining both Subgroups into a single Me 
predictable? Category, the concepts of ove 
and underprediction pay heed to possible 
differences in the Psychological makeup © 
Persons whose scores exceed their criterio” 
Status (overpredicted) and those whose score’ 


fall below their criterion status (underp!* 
dicted), 


at the median, individuals can be classifi? 
aS follows: high hits; high predictor-bi8" 


уны Over predicted: high predictor-10" 
criterion; low hits. low predictor-low С 
terion 


h ; and, underpredicted: low predicto" 
hig criterion, Each of these subgroups has, 
ngle unique combination of predictor-C 


- 


M 


! 
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om thus, the quadrant analysis 
the шу. homogeneous subgroups than 
аа, raic-difference technique by the 
the EL of the “predictable” portion of 
torially in = The approach is depicted pic- 

Int igure 2. 

"ME ary of the modified model, the “Job 
dealt with ro. "Situation" segments are not 
of develop irectly by any of these methods 

У чер =e moderators. However, by de- 
Predictor 51005 of individuals in terms of 
job eee scores, possible effects of 
into Poi. and situations may be taken 

her nt indirectly. 
Practica] | Te several theoretical as well as 
Proach, ni ge doe resulting from this ap- 
underpredion’ since the overpredicted and 
both on e groups differ from each other 
It seems oy ictor scores and criterion scores, 
8toups qi mee that they are two distinct 

Ortant in [ome in certain characteristics 1m- 
Bests that the prediction situation. This sug- 
Combining a single moderator, developed by 
Wo group Most of the individuals in these 

PS as in the absolute-difference ap- 
y Кы probably mask these poten- 
Опе mo cu Ant differences. Therefore, the 
roach o used in the absolute-difference 
8 predic Бе less effective in enhanc- 
lied j Соп than the two moderators im- 
that ig the quadrant-analysis technique, 
Separate Moderator developed on and used 
Sroups, Y for each of the poorly predicted 


Sec 
Ence teat even though the algebraic-differ- 
ШЕ ш nique also entails two moderators, 
Ргедӯе P$ Contain a much greater spread of 
the Son. Criterion scores than is the case in 
its, npe falling in the various quad- 
9 the : Addition, each of the two moderators 
Cbar, , adrant analysis is developed on 
aile and distinct “predictable” groups, 
егес tWo moderators in the algebraic- 
aPproach both use the same pre- 
ome ЕР in their development. There- 
org tinis of the effectiveness of the 
lcedig,., "ems unavoidable in the alge- 
Vhirg Ence method, 


on 
o. 


Overpredicted 


Median 
Predictor Scores 


Fic. 2. General diagram of subgroups resulting from 
quadrant analysis. (Predictor and criterion scores are 
used in a general sense, the predictor score referring 
to the single test battery score used to predict the 
criterion and the criterion score referring to the 
single score used as a measure of success in selection 
or test-validation research studies. 


and high-predicted subgroups. The quadrant 
analysis provides an opportunity to incorpo- 
rate such a finding, while the algebraic- and 
absolute-difference techniques do not. 

Fourth, by subgrouping on the basis of 
predictor-criterion score combinations, the 
quadrant-analysis approach makes possible a 
more complete analysis of the criterion. By 
comparing the quadrants having common 
criterion but different predictor scores, vari- 
ous different ways of achieving similar cri- 
terion scores may be studied. Such criterion 
analyses will become increasingly important 
as the emphasis on a single global measure 
of job success diminishes and the complexity 
of the criterion is brought under scrutiny 
(Dunnette, 1963a, 1963b). 

Fifth, from a practical standpoint, the 
four subgroups in the quadrant analysis are 
easy to obtain, requiring none of the com- 
putations necessary in the algebraic- and 
absolute-difference approaches. For example, 
the subgroups can be identified immediately 
from a scatter diagram by drawing two lines 
intersecting at right angles through the 
median predictor and median criterion scores, 

The above arguments seemed sufficiently 
compelling to warrant trying to develop two 
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sets of moderator variables designed to 
identity more and less predictable subgroups 
of managers in a study of the predictors of 
managerial effectiveness. 


METHOD 
Sample 


E consisted of 443 managers of the 
зл е of New Jersey and affiliated 
companies who had participated in а study de- 
signed to determine management potential early in 
an employee's career. This sample is particularly 
appropriate for this study for several reasons. First, 
the sample is large enough to permit the sub- 
Eroupings necessary in the quadrant-analysis ap. 
proach while also assuring a Teasonably large 
group for cross-validation, Second, the consequences 


these decisions 
; With the exception 
were included along 
with factory workers and foremen (Ghiselli, 1963), 
n made to determine 
can be developed to 


у offers a unique 
- Whereas most, ii 
previous moderators have been developed 
i i less with the cri- 
Rs resulting from 
EIMP Study were 


terion, the Shrunken multiple 


d value, If 50, this ought 
studying the "predict- 


become apparent 
ability” of the EIMP group 
The 443 managers 


in this Sample ranged in 
Organizational leve] from Chairman of the Board 
and President ОЁ the parent com 


2 The Early 
tential (EIMP) 


scribing the original EIMp 
Identification of Management 
by Harry Laurent, Assistant 
Relations Research Division, Standard. Ой of New 
Jersey, at a Division 14 meeting of the 
Psychological Association, St. 
1962. 


“The 
Presented 
Employee 


i American 
Louis, September 
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the 

at organizational levels equivalent to аро M. 
managers were also included. АП participat A 
on a voluntary basis, and the managers S t ip 
that they were taking part in a research P m 
which individual results would not be use! 
administrative purposes. " ey 

The average age of the sample, at the e ш 
were tested, was about 48 years иеа the 
they had an average of 21 years of Beawice a college 
company (SD = 9.0). Of the 56% who ж al? 
graduates at the time they were hired, s sample 
held graduate degrees. АШ but 39 of ү rn out 
Were or had been married, and 6% were bo or 3% 
side the United States. Representing the RS oil af 
of the 135,000 employees in the Standar in 935 
New Jersey organization, their salaries i 
ranged from about $14,000 to $250,000. | EDP 

The two subsamples used in the Eae ШЕ 
study, Sample A consisting of 222 Ss and i^ stud 
with 221 respondents, were used in the prese: mple n 
Sample A was used аз the experimental sa ed, 2 
which all moderator variables were c 
the experimental results were applied to 52 
for cross-validation, 


Criterion ave 

The criterion of management “success” use! ІМ? 
the overall success Criterion developed m т EU 
Study. Although this criterion score is сотр!“ 
measure, the recognition given to the vario 
nature of the managerial job and to the age hen! 
factors contributing {о success іп тапар, ш 


rreri 
E 5 al crite! , 
makes this Score superior to other global escrih 


Scores typically obtained on managers. a jnd 
tion of the development of this criterion wil 
the composite nature of this single score. 
The success criterion was developed "n 
main criterion measures: position leve po jio” 
managerial effectiveness, and salary history. M m 
level was defined roughly as the level an Hie 
organizational hierarchy to which the оп Wi 
advanced. Its use as a criterion was based о pa 
assumption that, in general, the managers P demo" 
advanced to the higher position levels had 
strated greater managerial ability. " f 
A ranking of managers on the basis E: И 
effectiveness in recognition ana, 
iveness existing between a. т 
апу {һе ѕате position ка We, 
an alternation-ranking рї0©© ye! 


ict 


th 
rat? 


] 
ne 
p" 


names who were at the same E 5 
Position level and in the same type of anal, 
Were ranked by at least three higher-level уя й 
Аз some evidence of the reliability of one 
а test-retest reliability of .93 was -—]5 
50 rankers ranked 1,284 employees 
within a few days’ time. 
Se 


n 
* This reliability study was conducted in lts Wi 


ently of the major research work, The c. 
Contained in Volume 3 of Social Science Ё 
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A e] ipm. the third criterion variable, was 
сей ‘by e belief that the amount of salary re- 
ow well A employee is based, at least in part, on 
that job Wh does his job and the value placed on 
of salary Be hile Tecognizing the obvious limitations 

as a single index of performance, it was 


ИШ fe 
vere nat salary information could add to the 
salary criteria e BE a manager’s effectiveness. Three 
averaged ке» Were used: a standard score salary, 
Adjuste, 
i od the effects of inflation; an average 
age; and а he same 5-year period adjusted for 
during each, Meng of the rate of salary progress 
he over, To career with the firm. 
all success criterion resulted from a 


factor anaq 
criterion y 
Steatest an 


ysis of these and many other potential 
ariables, The factor accounting for the 
“Onsidered S had high loadings on the variables 
tion leye > De the primary criteria, that is, posi- 
and was ONIS of effectiveness, and salary, 
Отегсо Us designated the success factor. То 
modest positive loadings on age and 
p ш» this success factor was rotated 
lent ou а final overall success factor 
Sing this s and length of service. 
à q т. Success factor, criterion scores were 
Verte, б or each participant, and then con- 
Stanines, Tt is this stanine score which 
4S the criterion in the present study. 


Predictoy 


The + 

ЫМ in edictor developed in the EIMP study, and 
riterio © present study, was as complex as the 
to ур Score b Predictor, too, was reduced (0 а 
* abili "t Once again it gave due recognition 
Y of individuals to obtain this score 
Configurations of test performances, 85 

© lest pss 
Stra ardizeq pond consisted of an interview, three 
тїз re eee and several experimental in- 
Mine "tion ыл, in total, about 8 hours of ad- 
nel т Anal ime. The standardized tests were the 
(оцы , de Test, Form H (Advanced Person- 
Co ‘lished Non-Verbal Reasoning Ability Test 
ment y), We Richardson, Bellows, Henry, and 
OF ү Survey the Guilford-Zimmerman Tempera- 
чое Соц; I? addition to the 10 standard scales 
of ae Коув td-Zimmerman Survey, experimenta 
Ne instrumer® developed through item analyses 
lieto, her nt 
Rs) 1 re- 
t аг, it he Individual Background Survey 
ion teas 
and family background, е 
acti Planning and experience, finances 
ivities, health history, and social and 
use Te- 
f back- 


UT 
A Сед Nity late 
rey, 05. Tts development and 


h Previo 
Ro Dr us Successes with this type © 


th Dog. eur 


Cse 40 New З 
аше она York: ESSO Standard. Copies of 
"sy t of a œY be obtained by writing to ra 


the Standard Oil Company of 


tn 
Un 


ground information in selection research studies 
within the company. 

A Management Judgment Test, comprised oí 
problem situations with several possible choices of 
action or decision, was another experimental in- 
strument included on the basis of previous suc- 
cesses using it in selecting first- and second-line 
supervisors. The purpose of this test was to de- 
termine the examinee’s judgment insofar as man- 
agerial problems are concerned and to compare his 
judgment with that of other executives. 

Other experimental instruments included a Survey 
of Management Attitudes, a Self-Performance Re- 
port, a. TAT-type Picture Technique, and a Per- 
sonal History Record. Since these instruments car- 
ried less weight in the prediction equation and 
thus were not used in the present study, a further 
description of them will not be undertaken. 

In the EIMP study, an item analysis of this 
entire test battery, consisting of over 1,000 items 
with about 5,400 alternative responses, was run 
against the overall success criterion. In terms of 
zero-order correlations, the Individual Background 
Survey correlated highest with the criterion, fol- 
lowed by the Management Judgment Test and 
the experimental key on the Guilford-Zimmerman 
Temperament Survey. : 

The multiple-regression equations, calculated for 
each of the two subsamples in a double cross-valida- 
tion design, resulted. in shrunken multiple Кз of 
71 for Sample ^ and .70 for Sample B. Scores 
based on the multiple-regression equations described 
above constituted the predictor variable used in 
the present study. The predictor scores used for 
Sample A in the present study were, of course, de- 
veloped from Sample B and cross-validated on 
Sample A, and vice-versa for the predictor scores 
used for Sample B. The modest differences in re- 
gression weights in the two multiple-regression equa- 
tions made the predictors somewhat less comparable 
than а predictor score resulting from a single, 
combined multiple-regression equation would have 


been. 


Development of M oderators 
ample А were divided into persons 
nd below the median on the predictor 
scores, Each of these groups was then divided at 
the median of the overall success criterion. How- 
rer, since the criterion score was expressed as a 
= ШЕ score, 41 individuals obtained the median 
wee of pP Placement of these 41 persons was done 
as follows: It reasoned that those with 
predictor scores below the median were underpre- 
ба (because they Were at the median on the 
criterion), and that those with „predictor Scores 
above the median were overpredicted (again. be- 
cause they Were at the median on the criterion). 
Figure 3 shows the quadrants resulting {from this 
reasoning and the numbers of individuals from 

Sample А in each quadrant. — 
pool for developing the Moderator 


The item ў : 
Tests included all of the questions in the In- 


The Ss in S 
scoring above а 


was 


? Underpredicted 


(55) 


Predictor 52975 


Fic. 3. Quadrants formed for Sample A and numbers 
of subjects in each опе. 


dividual Background Survey, 


the Guilford-Zimmer- 
Survey, 


and the М anagement 


The percent difference 


Statistic 
selecting item Tesponses for 


was used in 
inclusion 


in the mod- 


AND 
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erator tesis. An item or scale score response К 
included ii the percent difference rac ss 
high and low groups was significant at ud the 
level in a two-tailed test. In the present see the 
Percent difference necessary for significance wii 
:05 level was roughly 20%. Unit weighting а 
used for the item responses included in the mode d 
tests, since the case for differential ker 1 
item responses is difficult to justify. aw 
1954, 1956) on the grounds of a practical i 
in predictive efficiency. d total 
The three moderator tests, item, scale, wi iten 
(ie, the combination of weights from bot pt 
and scale differences), developed on the low 7 
dictor score Subgroups, were scored so that 2 hig 
score represented underprediction, For e scort 
predictor subgroups a high moderator test ine 
represented overprediction. Again, unit wi 
was used throughout. < of the? 
The method used to test the effectiveness ds prc 
moderator tests in identifying more and S the 
dictable subgroups of individuals is implied sub 
quadrant-analysis approach. Since the EWO оре 
groups on which the moderator test was ae ci 
have common Predictor scores but m cr 
terion Scores, the moderator test scores shou it t 
relate with the criterion scores, Therefore; ositit? 
moderator is effective, there should be a > nd 
correlation between moderator test score: in the 
criterion scores for the low predictor groups elatio? 
cross-validation Sample, and a negative corr С 


The greater ive 


RESULTS anp Discussion 
Low Predictor Groups 


ite! 
Table 1 presents the results of th det | 
analysis, the Tanges of scores on the 


TABLE 1 


"TESTS: 
› AND TOTAL MODERATOR TE 


TEM, SCALE, AND TOTAL t 
TS DEVELOPED ON THE Low PREDICTOR Groups ZA 
= = —— 
st 
tes 
Item moderator test Scale moderator test |" Total moderato! 7 
Пет variable analysis 
Number of items weighted 31 16 47 
Percentage of difference range 20-3267 76; Co 
Moderator test Score range = а Вб 
Developmental sample 7-25 7. 
Cross-validation sample 7-21 oer ard 
Moderator-criterion Correlation "ш i 
Developmental samples .б1+* 65** gp 
Cross-validation sample» ДЇ, eee a 
Е aN = 10, 
bN = 121. 
* p «.05. 
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TABLE 2 


R 
NESULTS OF [TEM ANALYSIS, RANGE OF SCORES ON 
AND MODERATOR TEs 


Trem, SCALE, AND TOTAL MODERATOR TESTS, 


-CRITERION CORRELATION FOR ITEM, SCALE, AND TOTAL 


MODERATOR Tests DEVELOPED ON THE HIGH PREDICTOR GROUPS 


ено габ test Scale moderator test Total moderator test 
m variable analysis 0-1 
po mier used oo 0 d s 
er i с | 
А fede eee of difference range 20-31% pas pied 
: ator test score range 
я velopmental sample 174 ЖП э 
i °Ss-validation sample R2 US es 
cL ator-criterion correlation jj 
Yelopmenta] sample EE Tss == 
ross-validation sample? = = = 
“Vv = 
i pA и. 
b > 05, 
"$0; 
a ; : 
tor tests predictor scores in common, while the item 


icted pr, designed to identify the underpre- 
erator E , and correlations between mod- 
tvelopm Scores and criterion scores for the 

ese ental and cross-validation samples. 
ator te pee indicate that the scale mod- 
effective +, And the total moderator test were 
in identifying more and less predict- 


moderator test fails to “hold up” on cross- 
validation. Effectiveness, as used in this con- 
text, refers to the ability of the moderator 
to discriminate between two subgroups of 
individuals both of whom attained similar 
res on a test battery, but different criterion 


sco. i 1 
From a practical standpoint, this 


Subgroups of individuals having low scores. 
TABLE 3 
Distripyrioy OF SCALE MODERATOR TEST SCORES ков UNDERPREDICTED AND edi SUBGROUPS 
IN балете A AND METHOD USED TO DETERMINE OPTIMUM CUTTING SCORE 
. Index of 
Cumulative frequency Cumulative percentage | differenti- 
ation (Low 
hit %—un- 
Р Underpre- | derpre- 
d re- А s ; 
C ES] Score Low hit E Low hit dicted dicted %) 
0 3 
0 3 
1 б 0 9 : И 
2 0 13 0 13 
e 2 0 19 0 19 
13 0 23 0 23 
4 16 ^ 37 0 37 
5 26 1 51 3 48 
6 36 3 61 8 53 
Op; T 43 7 70 18 52 
Ptimum 8 49 79 23 56 Index of great- 
Cutting 9 55 9 est differ- 
Score 12 87 31 56 entiation 
10 61 18 91 46 45 
Hn a 24 96 62 34 
12 67 Bs 100 72 28 
id о 34 100 87 13 
е "n 38 100 97 3 
16 70 39 100 di à 
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TABLE 4 


ISTRIBUTION О С. A 5 'ORES EDICTED AM ›н-Нїт BGROUPS 
S RATOR Test Sc S FOR OVERPRED: D AND Hicu-Hir Sc 
F SCALE MODE: S E 
| И SAMPLE А AND METHOD USED TO DETERMINE Optimum CUTTING SCORE 


1 
" Index of 
Cumulative frequency Cumulative percentage differenti- 
ation (High 
hit % = 
" à Overpre- ich hi Overpre- overpredic- 
Score иши dicted High hit dicted ted С) | 
1 4 0 5 0 5 
2 15 0 19 0 19 | 
3 22 0 28 0 28 
4 36 0 46 0 46 
5 44 1 56 3 53 
6 52 3 66 9 57 ч 
i 5 Index of grea 
Ораш 7 65 7 82 21 61 ш: difer- 
p 8 72 14 91 42 49 entiation 
9 77 22 98 57 31 
10 78 27 99 82 17 
11 79 31 100 94 6 
7 3 
12 79 3 100 | 100 0 M 


moderator test is therefore effectively iden- 
tifying the individuals for whom the original 
prediction, based on the test battery, would 
have been incorrect. These results provide 
empirical evidence that individuals having 
similar predictor scores but different criterion 


scores do show stable and predictable differ- 
ences, 


High Predictor Groups 


Table 2 presents results of the item anal- 


ysis, the ranges in scores on the moderator 
tests designed to identif 


y the overpredicted 
group, and the correlation between moderator 


test scores and criterion scores for the de- 
velopmental and cross-validation samples. 
These results indicate that all three mod- 
erator tests are effective in identifying more 
and less predictable subgroups of individuals 
having high predictor Scores in common. 

The results of the analysis on the 
predictor groups are therefore substantially 
the same as those for the low predictor 
groups. The major differences, a significant 
item moderator test correlation and sub. 
stantially greater correlations for the other 
two moderator tests developed on the high 
predictor group, are merely differences in 
magnitude. 


high 


Effect of Moderators on Validity 


The true test of a moderator is чеда, 
or not it improves the validity of a к 
battery. Therefore, we determined the е 
tent to which use of these moderators ше 
enhance the validity of the EIMP t€ 
battery. or 

Method. Only the two scale moderato, 
tests were used because they were mo ? 
effective in identifying their respective ie { 
groups. A cutting score was dete 
Using the method described by Englar 
(1961), for each scale moderator test on et^ 
in Sample A such that the percentage of e | 
laps between hit groups and the over- d 
underpredicted groups was minimized. T 
optimal cutting scores were then used 5 | 
eliminate individuals with high scores oe 
Sample B (cross-validation sample), 85 pe 
usually done with moderator tests, Since y 
resulting prediction is dichotomous, that v 
either high or low criterion Score, а pu. 
biserial correlation was calculated in ord j 
to determine the overall estimate of validity’ 

Results and discussion. Tables 3 and 
Present the distributions of scale moderato 
test scores in Sample A for low and b. 
Predictor groups, respectively. In additio" 


-—— 
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Dim TABLE 5 
STRIBUTION 
anth adi нна MODERATOR TEST SCORES IN 
левова AWO T PREDICTOR AND HIGH PREDICTOR 
ERCENT OF SUBJECTS ELIMINATED 
BY CUTTING SCORES 


Low i 
Predict, 
or subgroup | High predictor subgroup 


Score 
| N | Score | N 
б 0 i | = 
2 0 | 0 2 
a [23 X 45 
6 5 
Р 5 з |12 
6 15 4 8 
7 14 2 14 
17 15 
8 7 18 Cutting score 
9 9 ———— 
у=» 8 


156) E 
2 | 1Scuttingscor| 9 [6 
5 
1 


1 
T 16 10 
11 
13 6 
14 е 
Total 121 
Umber elimi Total |99 
im 
3525 a: Number eliminated 
à d 20 = 20% 
еу 
s 
Ор, how the meth 
ethod used to determine the 


Table $ ng Score. 
5 

req; a T inten the distribution of scale 
Cuttin 9t grou scores in Sample B for bo 
ated scores” a as well as the appropriate 
Point); able 6 and percentage of 55 elimi- 
Ss scDlserja] presents the calculation of the 
tests Sting hi pia ig for Sample B after 

Ree ave per, On the two scale moderator 
ед Ёш 


ең” а poi 3 nud 
Ws °Ч for Nt-biserial correlation was C 


EM th 


Wady 


е . 
Origi 
Origin; : 
a hi al regression scores to predi 


the 


зе 
u З 
> Use of the moderator variables 


he quadrant-analysis approac 


does enhance predictability. Thus, by elimi- 
nating only 25% of the Ss, the cross-valid 
point-biserial validity coefficient was increased 
from .65 to .73, and the degree of overlap 
between high and low criterion groups was 
decreased substantially—from 38% to 28% 
The difference in the two validity coefficients 
is significant at the .05 level. 

Another way of viewing these results is 
presented in Table 8. The percentage of 
accurate predictions is shown based on the 
regression equation alone and for the regres- 
sion equation plus moderators. Two different 
prediction problems are presented in this 
table, predicting а criterion score from 1 to 5 
and from 5 to 9, or in the other case, pre- 
dicting а criterion score from 1 to 4 and 
6 to 9. This dual prediction was à result of 
the modified quadrants used in the present 
study. Due to the standard criterion scores 
used, the underpredicted moderator (low pre- 
dictor group) predicted Ss having criterion 
scores of 5-9, while the overpredicted mod- 
erator (high predictor group) predicted cri- 
terion scores 0 1-5. Therefore, both mod- 


TABLE 6 
ORRELATION TABLE, MEAN CRI- 
AND OVERLAP STATISTICS FOR 
SUBJECTS ELIMINATED ON THE 


PorxT-BISERIAL С 
TERION SCORES, 


Sarre В WITH 
Basis OF QUADRANT-ANALYSIS SCALE 
MODERATOR Test SCORES 
ай Predict low Predict high 
Actual criterion score criterion criteria 
(0) (1) 
N N 
9 1 9 
8 0 11 
1 2 20 
6 2 18 
5 12 16 
4 25 5 
3 22 0 
2 17 0 
1 5 0 
Totals 86 79 
Mean criterion score 3.488 | 6.544 
Overlap* 28% 
fpbi 23 


is estimated fromlTilton's (1937) Tables. 
The figure denotes the rcentage of scores in one distribution 
ich are matched (overlap with) scores from а second compari- 


60 ROBERT HoBERT AND MARVIN D. DUNNETTE 


erator tests predict a criterion score of 5, 
and in this sense a criterion score of $ is 
always considered either underpredicted or 
overpredicted. 


The accuracy of prediction in terms of hit 
rate indicates again that the moderators im- 
proved on the regression equation. While the 
absolute improvement was small the im- 
provement was considerable relative to the 
range remaining within which to accomplish 
improvement. 


It should be noted, however, that one ef- 
fect of these moderator variables is to re- 
move cases (as unpredictable) located toward 
the center of the predictor distribution. This 


Thus, the moderators 
other than “merely” 
Tange of the predictor 
Examination of scatter 
diagram shows that one such Property is that 
the 55 so-called unpredictables are cases that 


TABLE 7 

POINT-BISERTAL CORRELATION 
TERION SCORES, 

SawPrE В Usrxc 


Actual criterion score Predict low | Predict high 
criterion criterion 
(0) (1) 
N N 
9 1 9 
В 0 12 
3 20 
6 9 25 
ә 22 25 
4 33 8 
3 29 0 
2 18 0 
1 6 0 
Totals 121 99 
Mean criterion score 3.760 6.303 
Overlap 38% 
ты 65 


^ See Footnote a of Table 6, 


TABLE 8 
T р 0 
PERC E OF ACCURATE PREDICTIONS um. 
i REGRESSIO 
REGRESSION. PREDICTION ALONE AND КЕСКЕ 
PLUS MODERATOR PREDICTION 


== 2 
А Regression plus 
Criterion Regression alone moderator 
scores = al 
predicted No. pre- | Percent | No. pre- rA 
dicted | accurate| dicted jace 
d$ Ч Г 
1-5 121 89 86 А i 
5-9 99 91 79 И 
Total 220 90 165 i 
0 
1-4 121 71 86 А, 
6-9 99 67 79 7 
Total 220 69 165 24 


а Of 
generally аге more distant from the line è 
relations than the 133 cases retained E 
sample, Thus, the variables are operati, 
moderators usually do, rather than “jus set 
creasing the variance of the predictor (0 
Even so, the tendency of the moderato? |, 
delete Ss lying in the central portion 0 eeh 
distribution suggests that it would have рат 
Wiser and Possibly more efficient to eat 
used tests and scales other than those alt in 
in the predictor set as a basis for devel0P 
the moderator variables. 


yi 
Description of Underpredicted and » 
predicted Groups j 


j 

The content of the variables and items ү 
the moderator tests proving effective. iud 
identifying underpredicted and overpre gi 
individuals Was examined. The purpose о i i 
examination was not so much to dete afi 
exactly why an individual was incor est 
Predicted, but rather to see if any hypo” y 
could be developed concerning different 
of unpredictability, di 

Looking first at the variables, it W45, inf 
€ 12 variables ident! od 
rpredicted group were also іпС p? 
Moderator test for identifying ipf 
edicted group. However, the 9C. jt 
se variables was exactly the opP^ y 
for the two groups. Thus, on each of th i ү 
Variables where 4 high score characte” yi 
the underpredicted group, it was a low “oll 
Which characterized the overpredicted £" 


underpr, 
for the 
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| mug р-на, This finding in itself is of 
М Vier id les for it suggests that 
may not cv icted and overpredicted groups 
А m be different, but opposite. — 
identity o. of these variables which 
dicted individ underpredicted and overpre- 
€ E scale "p is not too surprising. On 
Perament Su the Guilford-Zimmerman Tem- 
viduals tad the underpredicted indi- 
tional Stabilit © score high, indicating emo- 
enness o Y, composure, cheerfulness, and 
taineq by the pee The lower scores ob- 
of the im Predicted Ss are indicative 
Wi 

immer keys, O and F on the Guilford- 
Stoup G characterize the overpredicted 
Setting in Suspicious, hypersensitive, and 
less ы trouble (О), as well as having 
domination for others, less acceptance of 
(F). co and less toleration for hostility 
Moderator two keys did not appear in the 
Stoup, ^ test identifying the underpredicted 


e 
as aa predicted group was character- 
do; а Ving а eys developed experimentally 
Tina te ^ need, as well as the ability, to 
own i to have a good awareness of 
ere als ills and abilities. These two 
of“ groun p "Sed to identify the overpre- 
аһ, P> but their scores indicated a lack 
k Deed to dominate, as well as à 
On si "ledge of their skills and abilities. 
s developed experimentally by 
* m analysis of biographical and 
Score КЧ жа: different success factors, 
es hi Icted group typically had high 
€ overpredicted group had low 
the item content of these 
ep. Own, it is further evidence 
he hi; P" dicted individuals really belong 
Criterion group rather than the 
Stoup predicted by their test 
TSely, the overpredicted person 
On тош шые individuals in the low 
only pan in the high group. 
em moderator test which was 
Опе developed on the high pre- 
te item content indicates that 


n 


NS “dicte 1 


o MUN g, D Mviduals tend to worry 
ч th Alon er work, they feel the ability 
"T With others is less important, 


* life is rated less satisfactory 


than is true of the high-hit group. In addi- 
tion, high-hit individuals are more active in 
public affairs, come from more successful 
families, and generally have had a more well- 
rounded education and socially complete early 
life. 

Putting all of these variables together, the 
image of the underpredicted group emerges 
as one characterized by emotional stability, 
skills in interpersonal relations, self-confi- 
dence, broad perspective, self-insight, dom- 
inance, and aggressiveness. Overpredicted in- 
dividuals can be characterized quite simply 
as lacking these qualities. 

This description of the underpredicted 
group bears a striking resemblance to the 
time-honored “American success formula.” 
That such characteristics are related to suc- 
cess was noted by Laurent (1962) when he 
found successful individuals describing them- 
selves on the Guilford-Zimmerman “as being 
more stable emotionally, more objective, more 
friendly, and more able in their personal 
relationships" than the self-descriptions of 
less successful individuals. 

The hypotheses developed, based on these 
characterizations of underpredicted and over- 
predicted groups, have a theoretical as well 
asa practical significance. The descriptions 
of the two wrongly predicted groups suggest 
the hypothesis that there is a common factor 
underlying the differences. between under- 
predicted and overpredicted individuals. Thus 
the difference between underprediction and 
overprediction is related to quantitative dif- 
ferences on the same variables, that is, high 
and low scores, rather than to qualitatively 
different variables. 

These descriptions further suggest that the 
common factor underlying these differences 
is made up of variables which are in some 
way related to the criterion or success factor. 
Tf this is the case, perhaps future moderator 
tests can be developed rationally, in terms 
of the relationships between items or vari- 
ables and criteria, rather than sifting through 
a host of items which increase the spurious 
correlation and decrease the effectiveness of 

erator. 
- — of the modified prediction model, 
the interaction between predictors and in- 
dividuals creates different organizational out- 
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comes for some individuals with similar over- 
all predictor scores. The moderator tests, 
using a subset of these same predictors, ap- 
parently are able to specify which E of 
interaction will occur and how the outtome 
will be affected by identifying the variables 
(predictors) which are most likely to offset 
or compensate for either high or low Scores 
on the remaining predictors. Thus we have 
a differential weighting of predictors for this 
study, applied sequentially, to improve classi- 


fication by identi fyi 


IMPLICATIONS 


This study gives Support to the theoretical 
notion that the quadrant- i 


taken in this 


the moderator-variable 
follows: 


deni sample, 
Part of the sam 1 

= fi A X ampie 
likelihood that an гырт... Z i pi 


ES to the Ү=аҳ 
Y and X for p 


relations between 
Z [p. 142]. 


In the terms of this model the 


Subgroup would be the y — a Predictable 


appropriate for 
definition of the 


not appropriately handled by 


tion such as Y =Ъ/Х. Instead, the v 
dictable group really consists of two s 
groups of persons, those above and below | 
so-called line of relations (the line correo 
ing to Y = X). Theoretically, prediction 1% 
these two different groups would not m 
handled optimally by any single i 
Such as Y — b/X. Moreover, it is unlike! 
that there would be a high correlation " 
tween Y and 1/X in both unpredict? 
Sroups. It would seem, therefore, that ар 
absolute-difference method is actually ais) 
Propriate to the model described by ТУ gu 
and Rose, and that we may, in the long pe 
find it to be an inefficient and jmpraci 
method for developing moderator variab eš 
In contrast, the definition of more тайга 
predictable subgroups by the Б ek the 
analysis approach is more appropriate it айй 
Lykken-Rose model. Here, the low-h! who! 
high-hit Broups contain the persons for 1ай 
the regression line, Y — aX, is partic? anl 
appropriate whereas the underpredicte A by 
Overpredicted groups are better describ? 
Yzb/X However, in the quadr, li 
Proach, Z (the moderator) does COY gy 
with Y. The correlation results pmi 
veloping two moderator tests instead dici 
one. By truncating the range of pre“ y 
and criterion scores found in subgroup? y. 
Opportunity for positive and negativ? yel 
relations to cancel out is reduced. Mot wt 
since a major difference between the » m 
and underpredicteg subgroups is the , 4 
terion (or y) Scores, it is logical a f 
moderator test designed to identify p" 
Subgroups will be related to several ele or 
in the criterion, The same is true 107 "à 


0 
moderator test designed to identify the fo 


Predicted and high-hit subgroups. Ther ioh 
the relation be 


tween moderators and С? 
15 consistent with the model in this сазе. pg! 
The model also accounts for the fact (y 
the Overpredicted were characterized 45 pd", 
ing the same traits which typified the © edi 
Predicted. Tn fact, the model would Ру fi 
just such an Outcome. Since the Y ^ go 
line theoretically extends downward dic 
left to right, that is, from the underpre gh | 
quadrant through the overpredicted qua | 
а high score characterizing a trait f” | 
underpredicteq individual should app? 
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th 
on ein of the overpredicted person as a 
If ihe or lack of that trait. 

S e Predicted and overpredicted 
same a only quantitatively on the 
the low-hit es, and if the same is true for 
Which are im ae high-hit groups, both of 
then it may ыр in the Lykken-Rose model, 
quadrant-anal possible to identify the four 
Moderator te ysis subgroups with only one 
est, say, on st. By developing a moderator 
subgroups hi the underpredicted and low-hit 
Would indi igh scores on the moderator test 
Scores feli pa , underprediction and low 
diction, Thi indicate an accurate low pre- 
е extended | same moderator test could then 
da the overpredicted and high-hit 
eee reversing the inter- 
lias p» and low moderator test 
hio or the high-predictor sub- 
е an pa moderator test score would 
Score edis high prediction and a 

ethaps th indicate overprediction. 
lea дезе Macr most important implication 
сайп Жүз ts is the possibility of their 
pots of « renewed emphasis on the con- 
1019 ag Overprediction” and “underpredic- 
Ment» nn ае to those of “overachieve- 
Заде, b underachievement.” As has been 
" ^d Thorndike (1963), the concepts 
stance underachievement imply a Te 
mens titerion which seems to view predictor 
it the ав the infallible ele- 
е ж де ы, situation and indi- 
Dre SS, the с as the fallible element. In 
of ©Чоп im roncepts of over- and under- 
diffe е iction y fallibility in the instruments 
to Mt instr and direct a search for either 
мет ance a or new combining rules 
More раге eir predictive effectiveness. Tt 
happ Crate that the latter stance 15 à 
t Pening i * portrayal of what is really 
n test validation and selection 
that it is therefore potentially 
for generating research designed 
ction € instruments and the statistics 
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SELF-ESTEEM AS A MODERATOR OF THE RELATIONSHIP 
BETWEEN SELF-PERCEIVED ABILITIES 
AND VOCATIONAL CHOICE' 


ABRAHAM K. KORMAN 


New York University 


This research tested the hypoth 


likely to choose those occupations which 
abilities than those with low self-esteem. The hypotl 
-esteem as a то 
of these findings for a closed-loop system 
function of self-esteem also tend to rein- 


emphasizing further the role of self 
Occupational roles. Some implications 
whereby choice patterns which are а 


esis that high-self-esteem students are more 


they perceive to require their high 
hesis was supported, thus 
derator on the choice of 


force the level of self-esteem were discussed. 


т ; 
tin predictive power of “self-implementa- 
derlying the аз ап explanatory principle un- 
ceived а rai Vocational choice process has re- 
various ee amount of support from 
nder ion Sars in recent years (cf. Eng- 
Support h 0; Holland, 1963). Despite such 
there ar, owever, it is also well accepted that 
ences į а considerable number of other in- 
Portant F this process, among the most im- 
family » Which are social pressures from 
these in nd friends. It is also apparent that 
With the "ences may frequently be at variance 
Choice © Wishes of the individual making the 


n 
i n * " 

Viewpoint wort to reconcile these differing 
York into a common theoretical frame- 


ted els hypothesis has been proposed and 
Mee олет (Korman, 1966) that self- 
m бан аз a moderator оп the voca- 
| лекке, process in that individuals high 
8 les Which V would seek those vocational 
Per ceive ШЧ be congruent with ones' 
vq. bs. Е Characteristics, whereas _this 
ЗЧ wig, CY be the case for those indi- 
tie d low self-esteem. This hypothesis 
Ons; — TOm two major theoretical assump- 


1 
ww All 
Ш ony Other things being equal, individuals 


wiy Sage i : 
org та Ее those behavioral roles which 
кезш sense of cognitive balance 
the This z 
Re th 
Загоре № 
e R? F 
Em 


Teseg 
rch was partially supported by 2 grant 


e f 
W York University Arts and Sciences 
- Portions of this paper were read at 
Sychological Association, New York, 
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2. An individual's self-esteem or general 
evaluation of himself is part of his cognitive 
structure (self-esteem is defined as a persons’ 
characteristic evaluation of himself as an in- 
dividual; low self-esteem is characterized by a 
sense of personal inadequacy and an inability 
to achieve need satisfaction in the past; high 
self-esteem is defined by a sense of personal 
adequacy and a sense of having achieved 
need satisfaction in the past). 


From these assumptions it was predicted and 
verified that individuals high in self-esteem 
would be more likely to choose those occupa- 
tions which they perceived to be likely to 
satisfy their specific needs and to be in keep- 
ing with their self-perceived characteristics 
than those individuals with low self-esteem. 
Such choice patterns were predicted to be 
consistent with the high-self-esteem individ- 
ual's cognition of himself as an adequate, 
need-satisfying individual and the lack of such 
w-self-esteem person. 


cognitions in the lov 
The major purpose of the research to be 


reported here was to generalize these findings 
to the area of abilities by testing a пае 
of hypotheses which postulated similar rela- 
tionships between self-esteem, perceptions of 
the ability requirements of the chosen oc- 
cupation, and perceptions of one's own abil- 
ities. In particular, the following hypotheses 


were tested: 
Hypothes: 
esteem are 


having hig 
their chosen оссира 


js 1. Individuals with high self- 
more likely to see themselves as 
h abilities in those areas where 
tion calls for high abilities 
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than are those with low self-esteem likely to 
see themselves as having high abilities in 
those areas where their chosen occupation 
calls for high abilities; 

Hypothesis 2. For those areas Where the 
chosen occupation is perceived to call for low 
abilities, the individual with low self-esteem. is 
as likely to see himself as having high abilities 
as is the person with high self-esteem, 

This latter hypothesis provides a control on 
the results of the first hypothesis in that, if 
Supported, it would suggest that the high- 
self-esteem person does not describe himself 
in terms of a “set” to be more adequate in 
everything but rather as being more adequate 


just in those areas which are called for by 
the role. 


METHOD 


Subjects. The basic sample for 
sisted of 126 lower-divisio 
ern private university, 
made a fairly definitiv 
these, 70 Were male an 
analyzed Separately, 


For the two hypotheses, each sample was Split into 
high- and low-self-est, 


eem groups on the basis of ap- 
proximately top one-third and bottom two-thirds, 
in line with previous research, 
Measuring instruments, “Self-Esteem” 
ured by the self-assu 


sessing various abilities 
which have been isolated in different factor-analytic 
Studies. Examples of the abiliti 


Pace and place them in relation 
to one another,” “the ability to work rapidly and 
quickly with numbers,” and the abilit 


ities, and the 


verbal self-perceived skills. The 
liability of the questionnaire ha: 
(about 3 weeks apart). 


themselves With more 
test-retest item re. 


5 а median of 81 
abilities, 


1 sure vareer Description Question. 
naire. This instrument 15 similar į 


2 The author wishes to thank Eq 
for granting permission to use the 
Inventory, undated. 


win E, Ghiselli 
Self-Description 


ABRAHAM К. Korman 


А cupa" 
the subject is asked to describe his chosen Ee 
tion. In addition, the items appear in a 

Я tion 
g а Choice” was measured by » hec 
naire procedure found to have „high des (Kor 
validity and reliability in the previous ru pad s 
man, 1966). As before, all Шацы Rite 252 
ceived psychological counseling were elimi j 
ol. inister? 
y tis The questionnaires were e 
in at least two different sessions to (aides ps 
during regular class meetings of introduc Descr 
chology classes.3 In a few cases the ее Ques 
tion Questionnaire and the Ability Assessm meeti 
tionnaire were administered at the sheer this t 
since previous work by the author has foun enerall 
be a permissible procedure. However, 8 
these were administered in separate sessions. about 1 
The average time between classes was 
Weeks, with some considerably longer. еей the 
Discrepancy scores Were computed bety апд 
two highest occupationally required agree owe 
corresponding Self-perceptions, and the UN d 
occupationally required abilities and the cor the 1% 
ing self-perceptions, (In case of ties, оет eed) 
three and/or bottom three abilities were ute 


gd. р jas com! 
Each individual's discrepancy score was 
as follows: 


(a) For high abilities 


Discrepancy = ceiv? ! 
Occupationally — ap o 
Required 
Abilities 
(b) For low abilities w 
Discrepancy = ion? 
Self-Perceived — Occupatio 
Abilities Red ros 
Abiliti 


"m 
n 
Thus, Hypothesis 1 predicted that the m ouk 
would be less for the кешир А ш 
Ог the low-self-esteem group for te the 
5" analysis, while Hypothesis 2 predic 
be no differences for "low abilities. 


abilitie: 
would 


RESULTS ? 


p 
" outil 
The results of the investigation are "yg. 


marized in Table 1 and indicate that all 


sgh’ 

ig 
Potheses received support. That is, the ge! 
self-esteem Person sees himself as ee 3 
to meet the ability requirements of his је 


occupation than do 


p 
es the low-self-estee™ ^ qt 
A further check 


est 2, 

was made on these Г i 

as to whether there was any differenti” yj 
tematic tendency fi 


i 
A or the low-self-estee™ ‘vel 
vidual to see himself as low in self-per yf 
——— 7 "ma 
* The author is indebted to James Kirkpatric cs 
Donald D 


I | Davis for allowing the use of their 
In obtaining Subjects, 
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TABLE 1 


SUMMA 
P RY OF RESULTS-DISCREPANCIES BETWEEN SELF- 
ERCEIVED ABILITIES AND ABILITIES CALLED 
FOR IN CHOSEN OCCUPATION 


Hypothesis 1: Hypothesis 2: 
Moderator High abilities Low abilities 
Males | Females | Males | Females 
Чан self-esteem | 
SD 67 72 97 73 
N 67 91 97| 75 
27 [ 27 19 
ы self-esteem D 19 27 
б 123 | 1.09 1.10 
N А6 42 | 110| 2+ 
43 37 43 43 
t 5 
30739 1.68* .50 1.76% 
В == 
a QES.—AII t m 
T ests а -tà » 
°рро his would have been шешне at the .05 level in the 


Site direct; 
b <litection from that predicted for a one-tailed test. 


"p <.01; 


abin 
ое. : F ompared to occupational require- 

tilizing en matched against high self-esteem. 

e соусу andom sample of 53 cases from 
the EE sample, this was found not to be 
Quireq ine mean discrepancy between T°- 
S Ted ility and self-perceived ability, when 
low wean T for all items (high, medium, and 
omea exactly the same for the high- and 
two dea, tem groups when carried out to 
&cimal points, 


T Discussion 
tion e Tesults support quite strongly the no- 
Nore ii t individuals with high self-esteem ате 
tions . &ely to seek out and accept the situs- 
Rh self ich seem to be in keeping with their 
Hence “Percept, that is, a “balance” situation. 
Self ae y, Person who thinks of himself/her- 
likely ү "eng adequate and competent 15 more 
Sinks 9 Wind up in these situations where he 
Such si © will be adequate and competent. 
Sttuati Ituations are not, however, «palance 
Ons for those who feel they are inade- 


һе 


quate and incompetent and hence appear to 
be less of an incentive for them. In fact, as the 
results for the females show here (and as 
trends in the previous research indicated), 
they may even tend to choose an occupation 
which calls more for their low abilities than 
their high. 

Since one's own self-perceived abilities are 
related to one's actual abilities to at least a 
modest level (Arsenian, 1942) and since self- 
esteem results from one's self-perceived ade- 
quacy in given roles, an interesting possibility 
for a closed-loop system presents itself here in 
that the low-self-esteem individual is more 
accepting of situations where he does not think 
he will be adequate and where he actually 
will tend not to be adequate. This will lower 
his self-esteem even further and lead him 
even further to choose roles where he does not 
think he will be adequate. However, just the 
opposite would take place for the high-self- 
esteem person. 

А similar closed-loop situation would present 
itself in the noncognitive areas in that low- 
self-esteem people would be more likely to 
social roles that are non-need-satisfy- 


accept atis 

ing. This would lead to non-need-satisfying 

situations and thus а further lowering of 
self-esteem. 
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WEIGHTING COMPONENTS OF JOB SATISFACTION' 
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University of Illinois 


ous aspects of their job. 
d (e.g., Glennon, Owens, 
960) that such a pro- 
important dimension, 
portance of each com- 


It has been suggeste 
Smith, & Albright, 1 
Cedure overlooks an 
namely, that of the im 
ponent to the employee. Tf the dimension of 
importance is a meaningful one, the satisfac- 


tion scores for employees should be treated 
Very differently, 


and to disregard t 
about the factor [p. 451].» 
The question arises, 


I however, as to how to 
assign proper numeric 


al weights to the vari- 


à € Writer also 
wishes to thank Abraham K. Korman and Joseph 
Weitz for comments an nks are also 
due to the companies participating (on ап anonymous 
basis) in the study; to or permission 
C. Smith for 
eutral points 


? Now at New York University. 
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rrive at weighted overall job- 


Scores on an 8-point scale of importance 
ea “satisfaction-times-importance” total 
the unweighted total; (b) the unweighted total 
independent 
totals. However, 
scale was more 


is 
ous components. Research relevant to € 
question has not led to a clear-cut pon ies 
Unfortunately, some job-satisfaction S e 
have used importance measures withou ntia 
termining whether or not the eet 
weighting provided by the importance s RU 
ures provided any additional information ores 
contained in the unweighted total ont 
(totals using unit weights for all compone ad 
For example, Glennon et al. (1960) wn 
that it is essential to subtract satisfac ge 
Scores from importance scores in order to 8 » 


A | : топ, How 
meaningful estimates of job satisfaction. ^^. 
ever, the writer 


S presented no empirical " 
dence in support of their idea. Larsen eas 
Owens (1965b) used a 5-point scale to mio? 
ure importance and multiplied заеме а 
Scores by importance scores to arrive 
Weighted total. The relationship bet 
weighted and unweighted totals was he tor’ 
Ported. In those cases where investiga 
ave attempted to assess the merits о ее? 
importance measures, the results have 


e erg 
conflicting, On the Positive side, Youngb ing 


i 
Hedberg, and Baxter (1962) found that Us!” 
importance an 


gether produce 
tion measures 
authors themse] 
Was available a 
be validated. 
found that ite 
in importance 
termined by a 


d satisfaction measures fac 
d better results than satis he 
used alone. However, as E 
Ves stated, no outside crite " 

gainst which the methods (960) 
Froehlich and Wolins "m р 
ms low in satisfaction and de 
best defined satisfaction а5 C^. 


factor analysis. On the nc£ 
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Е Decker (1955) and Schaffer (1953) 
Sami E. weighting by rankings on a 5- 
Ame а did not significantly improve the 
айал between the weighted sum of the 
faction rad and a measure of overall satis- 
most io : affer did find, however, that the 
correlated rtant component was more highly 
Ше than with the overall satisfaction meas- 
arsen e the least important component. 
importan Owens (1965а) found that an 
in a stu ay scale failed to make a contribution 
items to Ha the assignment of job-attitude 
examined t scales. Smith and Kendall (1963) 
the literature and concluded that: 


An 
iere ае when dealing with summed 
E eras ааа appropriate weighting for 
used include olved. The methods that have been 
Mg to rated equal weighting, or weighting accord- 
ot Weightin Raa сун ... Whenever the effects 
Безе 45. nive Байге, thoy have not im- 
Or their rel г psychometric properties of the measures 
[р.в], tionships with other, objective variables 
Ty yi 
Present or of the conflicting evidence, the 
: nC. was designed with the purpose 
"DB proc ing the merits of different weight- 
еге ad edures, Three separate procedures 
opted for this purpose: 


l. 
totals Computation of correlations between 
and ШЫ at using differential weightings 
Weights fe, arrived at using equal (unit) 
d pr 9r all components. The usefulness of 
Ghi, p; ce dure has been pointed out by 
"ште nd Brown (1955); although their 
is phrased in terms of weightings 


Of rant 
8s of different aspects of job perform- 


ance 

H > 

Situation: argument applies to the present 

ће сое 

ass М н of correlation between the final rat- 

in atings e items are equally weighte 

vendes t When they are differentially WS; 

Whe, igh ui necessary index. If the coefficient 15 

стаз if the the weighting system adds nothing; 

Cat E а е coefficient is moderate ОГ low, the 
"124-170 ет сап be said to be contributing 


Dr les " unweighted totals yit 
(дасһ us all job satisfaction. This is the Ар” 
a 953). ed by Decker (1955) and Schaffer 
“Bnific f the weighted total does not yield 
antly higher correlation with an over- 


all satisfaction measure than does the un- 
weighted total, this would argue against the 
desirability of using weighting by importance 
for purposes of determining overall job satis- 
faction. 

3. Tests of hypotheses. In addition to 
simply computing correlations between the 
various total scores and the overall measures 
one may make tests of hypotheses whick 
should hold if the totals weighted by the im- 
portance measures аге more indicative of 
overall job satisfaction than the unweighted 
totals. It may be hypothesized that people 
who state that a component is important and 
who are dissatisfied with that component 
should show greater overall dissatisfaction 
than people who are dissatisfied with the 
component but who state that it is not im- 


portant to them. 


The purpose of the present study is to de- 
termine whether or not importance measures 
give useful information, over and above that 
provided by satisfaction scores alone, for 
purposes of estimating overall job satisfac- 
tion. If such is the case, the weighted totals 
should be more highly correlated with in- 
dependent measures of overall satisfaction 
than are the unweighted totals; and hypoth- 
esized differences in overall satisfaction 
should occur as à function of both the im- 

ortance of a component and the satisfaction 


with that component. 


METHOD 


Subjects 
Subjects (Ss) were obtained from three large 
midwestern manufacturing companies. А 
Sample А consisted of 21 males employed in the 
personnel department of a company making elec- 
trical products. The Ss mean age Was 46; mean 
mean company tenure, 18 


education, 16.3 years; 

vears; mean job tenure, 104 years; mean annual 
pay, $10,900. 

Peps B consisted of 22 males and 1 female 


doing various kinds of jobs (e.g., accountants, agri- 
cultural research workers) in a food manufacturing 
company- The Ss’ mean age was 31; mean educa- 
tion, 16.3 Years; mean company tenure, 4.5 years; 


mean job tenure, 1.7 years; mean annual pay, 
$10,100. | 
Sample С consisted of 80 males and 40 females 


kinds of jobs (e.g, accountants, shop 
bar detailers, IBM equipment oper- 
nufacturing company. The Ss 


doing various 
order writers, 
ators) in а steel ma 
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5; tion, 13 years; mean 
an age was 33.5; mean educa! ion, 3 à 
ООРУ tenure, 6 years; mean job tenure, 4 years; 
an annual pay, $5,300. 
The sample sizes stated above represent the final 
sample sizes after the elimination of careless Ss. The 
data for 1 S in Sample A, 1 5 in Sample B, and 23 
Ss in Sample C were dropped due to numerous 
omissions and/or incorrect methods of responding. 
(See Ewen, 1965, for a complete discussion of this 
problem.) 


Methods of Data Collection 


The methods of data collection varied fro: 
to sample. Ideally, all questionnaires 
been administered and collected at th 
the writer. Unfortunately, 
Sample A, the questionnai 
collected by an official of 
Sample B were given the 


m sample 
should have 
е companies by 
this was not possible. For 


u 
For Sample © 
dministered and collected at 
трапу time, by the writer. 
the “best” of the three samples 
of both sample size and data- 


representing a rate of return of 40%. 
the questionnaires were a 
the company, on co 
Clearly, Sample C was 
from the point of view 
collection methods, 


Instruments 


E comprehensive 22-page questionnaire was de- 
Signed for use in this study, The time required to 


Structed mea. i tc 
day [p. 100]. Thi І is an adjective checklist 
ез satisfaction wi five aspects of the 
т, the co-workers, 
es have Teliabilities 

Measures of importance, These included the fol- 
lowing: 

1. A traditional 8-point scale, 
the importance of each 
rately by checking an 
ponent. 

2. A ranking scale, where S 
in order of their importance to 


» Where S 
component o 
8-point scale 


evaluates 
f the job Sepa- 
for each com- 


ranks the 


: components 
him, 


In addition to the five co 


mponents measured by 
the JDI, the importance me 


‘asures also included the 


B. Ewen 


ity. working condi- 
components of recognition, security, working 
tions, and achievement. . | "m. 
аники ој overall job satisfaction. Thes 
cluded the following: 


; Rothe, 

l. The Brayfield-Rothe Index Chad rye 
1951). This is a questionnaire consisting pA his jol 
dealing with the workers feelings fowar $7. Some 
as a whole. The reliability of the Index is 5 Sus fe 
evidence favoring the validity of this Index 

orted in the 1951 paper. ЖИП: 53). 
i 2. The General Motors Faces Scale (uni D are 
This is a one-item graphic scale. Five a large 
Presented, varying from a large smile vidi most 
frown. The S is asked to check the face w job 25 
closely represents the way he feels about Validated, 
à whole. This particular scale has not been va dimen- 
but faces scales for particular JobrsatsiacHon с an 
sions have previously shown good cone Hulin 
discriminant validity (Locke, Smith, Kendall, 
& Miller, 1964). 


Procedure 


job 
we all jo 
The following methods of estimating overa 
satisfaction were used: 


ally): 
1. Unit weights (weighting all component e this 
Since importance measures were not Bee thod was 
method, the total score obtained by this те 
alled the unweighted total. Р al 
m баш ш 8-point scale. These Impor er 
scores and the corresponding satisfaction scor “times” 
multiplied together, yielding a “satisfaction 
importance” weighted total. d ion 
3. First-ranked component, The satisfacti 
the component ranked first in importance was 
as the estimate of Overall job satisfaction. | factio? 
4. First three ranked components. The er ird 
with the components ranked first, second, an ate 
in importance was averaged to yield an estim 
overall job satisfaction. 


nce 


with 
take? 


son 
, isfacti 
Two additional estimates of overall job sati 
were also included: 


ton scot? 

5. The employee's single highest satisfaction k in 

regardless of the importance of the compone 

volved. + score 
6. The employee's single lowest satisfaction 


h 
и сас 
Аз а preliminary step, the neutral point ÍOT © „р 


scale was calculated, 


This was necessary. Е 4 
the third method, involving the tests of vario our? 
Ро езе, required that Ss be divided into 61000) 
which 


were satisfied. 
each component, 


= 123 and N = 130). The г 
and female employees perío con” 
п а large company. The data саф 
cores and Face Scale scores i jed 
linear regression analysis was х= e 

omponent. This was done sepa! pf 
D. The neutral point on any ion 
n to be the point on the ан 30 
Sponded to a Faces Scale score 


Component, A 
Out for each ¢ 
for each grou 
Scale was take 
line that corre 


—— 
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ne 
{ utral face). The results of the two groups were 
n close agreement. 


RESULTS 


i pee analysis involved the correla- 
"es puse: the weighted _and the un- 
in Table 1.3 als. These correlations are shown 
мы! Suipi C, the scores of 19 Ss were 
these Ss тош the ranking scale analysis. Of 
the JDI 8 ranked variables not measured by 
tance, а Ae security) as first in impor- 
correctly, 1 filled out the ranking scale in- 
у. 

me юй striking finding occurred in the 
Portance = traditional 8-point scale of im- 
Weighte, d b he correlations between the totals 
total we y this method and the unweighted 
amples p^ approximately .99 for all three 
Clearly di hus, the traditional 8-point scale 

obt id not add any new information to 

he кын from satisfaction scores alone. 
Correlated er weighted totals were also highly 
Correlatio with the unweighted total. These 
at the ns, however, were sufficiently low 50 
Correlati oes could have quite different 
1s ns with other variables. Since there 
efinitive rule as to how high a coef- 
Should be before it can be concluded 


S 


ficien t 
that th 


~€ Weighting methods are not adding any 


A tal 
tween Able showing all of the intercorrelations be- 


t e * 
© the athe scores may be obtained by writing 


TABLE 2 


Various WEIGHTE 
INDEX AND THE 


CORRELATIONS BETWEEN ТИЕ 
THE 


TABLE 1 


CORRELATIONS BETWEEN THE VARIOUS WEIGHTED 
TOTAL SCORES AND THE UNWEIGHTED TOTAL 


Correlation with unweighted total 


Weighted total 
Sample A | Sample B | Sample C 


(№ = 21) | (N = 23) | W = 120) 
——— 
8-point scale 98 99 99 
#1 rank 69 .63 705 
#1-3 rank 84+ 71 878 
“Most satisfied" .82 .59 81 
“Least satisfied” 85 88 88 


a These correlations are based on an N of 101. See text for 
explanation. 


additional information, the reader will have to 
decide for himself whether or not the coef- 
ficients shown in Table 1 are sufficiently high 
to cast doubts on the usefulness of the im- 


portance measures. 
The second analysis involved the correla- 


tions between the various total scores and 
the measures of overall satisfaction. These 
correlations, together with the intercorrela- 
tions between the overall satisfaction meas- 


ures, are shown in Table 2. . 
Table 2 indicates that none of the impor- 
tance measures yielded weighted totals which 


геге Si. nificantly more highly correlated with 
Ta Brayfield-Rothe Index and the Faces 
Scale than the unweighted total. This would, 
of course, argue against the inclusion of im- 


p ToTAL SCORES AND THE 
Faces SCALE 


BRAYFIELD-RO 


Sample B Sample C 
Sample A = N- 
(N= 21) (N 23) ( 120) 
| эз” 
BR NM pR F BR Е 
= | m 50 70 66 55 
13 1 “48 68 66 56 
15 “54 59 63 618 50% 
ompone r^ 57 40 E 64" 57а 
" tho ent rank 3 ё 
“Mest mea ted least important (among 24 33 ES E 18% 
Lett sation’ by JDI) 44 m 00 24 "58 47 
Qo, sati ed component? 59 61 53 115 "53 46 
elatio "led co » 4 / 
"relatio sted mponent' 55 m 88 62 


ns 
"T tween BR and F 
hes, 
е со 
"relations are based on ап N of 101. See text 


t for explanation. 
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' INTEGRATION, 
LATIONSHIP AMONG SUPERVISORS 3 
= SATISFACTION, AND ACCEPTANCE OF A 


i is study t 
. Several months prior to this s 
that individuals are more likely to accept 


TECHNOLOGICAL CHANGE 


NATURE OF ТНЕ CHANGE Я 


І h man m an 
i е! 
t of teel foundr introduc . 
art of the Broup that anagement o а stee y 


А д ЕР. 
"un A electronic data- rocessing system ( "m 
intends to initiate the change. Technological This: new ities, did ПОК affir the manuf i 
changes are critical events for lower-level turing technology directly, but was an 
supervisors because they are often not fully 


Fm я Е е опей 
: ministrative device primarily design 
accepted members of management, and Since 


А uling 
T aggravate their PrOCess information for accounting, ached e 
авв invento control, and payroll urpose». 
ith the management Ty 2 pay! P 


А arily 
н fecti f depended prim?) 
group they tend to resist them. The integra- — S ectiveness of the system is 


of integration оп their acceptance of tech. Not only were the 


tion to the acceptance of the chan visors Mave t 
their relationship to integration. 


level of Satisfaction of the tion supplieq by 


mensions which seemed БУ T des aed 


identi- ©” the information which supervisors prov", 

rs have been identi- and the accuracy of the one they i 

effects of their lack supervisors the ше е 

t yet been atudie d. Cibients of the Change but the success ШЫ 

this study is that SYstem was directly related to ther ti iti 
Dervisors with the Ness to accept the additional =, E 

ibuted to the failure it required, The change failed and inform 
System was discontinued because the in 


А u 
the supervisors a т 
is willi able. i i isors а e 
© his willingness lable Interviews with supervis n 


re 


e 
Е 3 л ns assum! 
Owever, satisfaction and Vealed that they were unwilling to 


e. : n; 
© independent of each — additiona] fasks required by the syste 


5 the case in this study) Mzrnop 


their loyalty Setting апа Subjects 


df 

js 800, 

ОЁ the foundry in which Шр шс, 
аге devoted primarily to the Port? 
VY castings. The operations are р su er 
1,200 blue-collar workers, 4 Ti 
department superintendents. рр 


= nage! "s 
x : ^ management group consists of a general ma 8 
atisfaction With man. hi 


his immediate staff 
sistant genera] та: 
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wo 


| 
| 
| 


| 


ACCEPTANCE OF TECHNOLOGICAL CHANGE 5 
12 


Union and 

ships with du id of them maintain social relation- 

isor has held ү paid employees. The average super- 

ll russe P position for 10 years. Due to the 
е ОЁ the organization, opportunities for 


Promotio 

n " pues 

аге ethnic d extremely limited. In addition, there 
manage educational differences between the 


ment group and the supervisors. 
Variables 
The а, 
With t = ер variable was selected in accordance 
Telate integra research interest of this study to 
fheir ссер!ап оп and satisfaction of supervisors to 
ea a inst Of a technological change. There- 
ins ute pese scale was constructed to 
in allment of th SN attitude toward this change, 
dM this scale deilt DP system. The items constitut- 
ү Understand: with the supervisor’s acceptance, 
nefits ang Е) Of Ње system as well as the 
a Sets of Poss Eenerated by it for him. 
asse, COMSisting pp, variables were used. The 
mene the a two variables, was designed to 
Was d тор, The Ba, integration with the manage- 
Viso "signe, tg iiie consisting of three variables, 
Th Satisfaction, SS various dimensions of super- 


follow; Rtegrati А 
p E sum: lon variables were measured by the 

зар, ation ened rating scales: 

felt а alt with th Management: The items of this 

there Patt of ma he extent to which the supervisor 

and his ere confi e o ment and the stand he took when 
The С, Or hates Of interest between management 


Whig evine: 
than ich зат These items dealt with the extent 
Тыта chan Pervisor relied on informal rather 
follow; Satisfaction’ of communications. 

3055.8 Summ n variables were measured by the 
a (ction ated rating scales: 

MES e Immediate Superior: The items 
as P the extent to which the 
ups, man ш! with his superintendent's 
апсы ten ene 028) and administrative skills, 
atip ang respon e vard influence, downward 
Win the SU wit е for his own decisions. 
mith qe extent to Management; These items dealt 
“Al ski Аас which the supervisor was satisfied 
5 of ty. tative, human relations, and tech- 


е 
management group. 


a 


Sp 
ы, TABLE 1 


Кы 
NS Seares пыш, COEFFICIENTS FOR ALL 
25 USED IN THE STUDY 


——————Є——=—=——— 
Жы, 
у ariable Tu 


TABLE 2 


OBSERVED CORRELATIONS BETWEEN THE CRITERION 
VARIABLE AND THE INTEGRATION VARIABLES | 


Variable 1 2 3 
1. Integration with management | 1.00 —.34* 31* 
2. Grapevine 100 —25 
3. Attitude toward EDP 100 
Note.—N = 40. 


p <.05 (two-tailed test). 


Job Satisfaction: These items dealt with the super- 
visor's satisfaction with his job, pay, promotion, and 
progress in the company. 


Reliability ој Scales 

The internal consistency reliability coefücients for 
all scales are shown in Table 1. It should be noted 
that they are all statistically significant ( < .01) 
and of sufficient magnitude for the analysis of group 
data. The above scales were administered 8 months 
prior to the discontinuation of the EDP system. In 
order to preserve anonymity respondents were not 
asked for any identifying information on the ques- 
tionnaire. 

RESULTS 


Relationship between Integration and Attitude 
toward EDP 


As hypothesize 
ervisors are more 
system if they are integrate 
agement group. 
The observed correlations between the cri- 
terion variable and the integration variables 
are shown in Table 2. The “grapevine” varia- 
ble related significantly—inversely—with in- 
tegration with management: those supervisors 
who report that they receive most of their in- 
formation from “the grapevine” are less likely 
to be integrated with the management group. 
The correlation between the EDP variable 
and the “grapevine” variable is inverse, as 
redicted, although it is not significant. The 
overall picture that emerges 1s quite clear: 
those supervisors who are relatively well in- 
tegrated are more likely to view the introduc- 


tion of the EDP system as beneficial. 


d, the results show that su- 
likely to accept the EDP 
d with the man- 


Relationship between Satisfaction and Aiti- 


tude toward E 
As expected, 
nificantly relate 


attitude toward EDP is sig- 
d to satisfaction with both 
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TABLE 3 


OBSERVED CORRELATIONS BETWEEN THE CRITERION 


VARIABLE AND THE SATISFACTION VARIABLES 


Variable | 1 2 3 4 


1. Satisfaction—immedi- 


ate superior 100 21 .43** 11 
2. Satisfaction—manage- 

ment 100 .14 .36* 
3. Job satisfaction 1.00 37° 
4. Attitude toward EDP 1.00 


Note.—N - 40. 
+} <.05 (two-tailed test). 
** p <.01 (two-tailed test), 


management and job. Satisfaction with im- 
mediate superior is significantly related to job 
satisfaction. However, an unexpected but im- 
portant result is the lack of a significant rela- 
tionship between satisfaction with immediate 
superior and attitude toward EDP. Moreover, 
two seemingly related variables, satisfaction 
with immediate superior and satisfaction with 
Management, are not significantly related. 
These results are shown in Table 3. 


Relationship between Satisfaction and Inte- 
gration 


Table 4 shows that some of the integration 
and satisfaction variables are not independent 
of each other. The pattern that emerges is 
quite consistent. Integration with management 
correlates significantly with all three satisfac- 
tion variables, and satisfaction with manage- 

nificantly with the two in- 
S. Without exception, the 
nships focus on the manage- 


G SATISFACTION AND 
NTEGRATION VARIABLES 


: Integration 
Variable with Grapevine 
management 
Satisfaction—immediate 
superior 37* —.18 
Satisfaction—management 42* —.33* 
Job satisfaction .56** —.16 


* p < ‚05 (two-tailed test). 
** p < ‚01 (two-tailed test). 


Discussion | 


The results of this study indicate a 
supervisors are more inclined to accept e. 
nological change if they are well n 
with, and identify with, management. tion Ë 
dition, this study shows that diseatisiee’ a 
related to lack of integration and als ors V 
tributes to the unwillingness of supr а 
accept a management-initiated techno! 
change. st 

Another noteworthy finding is that ма 
pervisor's satisfaction with his immedi toa, 
perior was unrelated to his willingness id 
cept the change. However, his satisfacti to P 
management contributed substantially isla” 
acceptance of the EDP system. Job Sa pag” 
tion, which reflects satisfaction with B a i 
ment policies regarding pay, Bremer de 
Working conditions, is also a . wa 
terminant of the supervisor's attitude, i 
change. These findings suggest that t { ur 
of resistance to change is not always ngo! 
Workers and that supervisors are not ange: | 
to resisting a management-initiated ch єсїї 
technological change that centralizes and P! 
making, as did the one in this study, 27,0 
fact eliminates an entire level of c at 
(in this case the superintendents), m a 
the relationship between the lower-le T 
pervisor and the management group:, Ke 
these conditions, the top managemen east ^ 
the place of immediate supervision at m 
the view of the lower-level supervisors. as 
the introduction of the EDP system inet yi 
the saliency of top management as 4 
of dissatisfaction for the supervisors. 

The above results are supported bY 
views and observations made by the g 
in this plant during the attempted pet Á 
of the EDP system and subsequent to ре 
Continuation of the System. These е P 
tions revealed that the integration © jj) 
Supervisors with the management group ag 
to the technologica] change was unsatiS af 
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U 
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H +. + rd! 
maintained Strong social ties with subo" o i 
and under conditions of stress it was ™ 
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commo 
wit. а Бка to return to the bargaining 
tight to return ontract guaranteed both their 
seniority. Su and the maintenance of their 
inequities in pervisors also complained about 
were han dine es Due to overtime work they 
Were ibis А checks to operators, that 
Pervisors als, ially higher than their own. Su- 
an pores reported that their grievances 
Slderation Ъ ns did not receive sufficient con- 

pes bs the management group. 

agement ium е conditions that the man- 
ls new © » uced the technological change. 
large the ai a was meant in part to en- 
of the le of managerial responsibility 
Closely with mu and to integrate them more 
S e Me ciii group; contrary 
е ures act ns of the supervisors the new 
‘vention ani increased the direct in- 
hs managemer pressure for production by 
e superints = resulted in the bypassing 
thie iur н ents. The supervisors were 
8 Condition epe with management, but 
> increased enin of facilitating integra- 
issension between the two 


groups. The supervisors experienced the new 
relationship as close and punitive supervision 
The technological change, therefore further 
aggravated the problem of integration of the 
supervisors and resulted in their unwillingness 
to accept the change. > 

In summary, under conditions in which a 
technological change results in the flattening 
of organizational structure, lower-level super- 
visors will be more inclined to accept the 
change if they have a sense of belongingness 
to and satisfaction with top management. 
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| 
TAT CORRELATES OF EXECUTIVE PERFORMANCE | 


n Affiliation, п Power, n | 
n Aggression, and n Deference in 2 Eroups of Ss. The 1st group 


ul business executives, the 2nd of less successful ч | 

» largely from the work of Henry and McClelland, tha 

significantly higher Scores than the less | 
| n Autonomy; whereas the 


i es in n Affiliation, n Ageres- | 
sion, and n Deference, The succes: i 


gnificantly higher scores in 


unsuccessful ones. The implications of | 
these findings were discussed. 


The most comprehensive delineation of 2-3]." aly associ? 
the executive personality to date has been entrepreneurial Success are strongly {ой 
achieved by William Henry (1949), Al- 


though the individua] perso 
to some extent by the inter 
executive role, Henry mai 
Process of executive selection 


those individuals « 


individual has (a) « 
initiating decisions,» 


, 


whose Personality struc. 
ture is most readily adaptabl 
ticular role [p. 286].» 


t 
Deference, as well as n Achleveine "i 
utive and which would lend examined. These additional moV ne 
pirical validation, Selected from Murray’s (1943) list ipt 
ieving Society, McClelland 


eurial” 
different Countries, Месје 


al occupation a 


й 
" ent 9^. 
He concludes that n Achievement "i 
iis Я ot | 
and that when ап association is n' 


d 
Ге 
: г mor 
nality is Shaped between these variables, then one : reni 
nalization of the the conditions defining the enterp 
ntains that the 


Tole have not been met. tend ui 

tends to favor The present Study proposed to ч ement i 

Clelland's findings relating n arber © 

"entrepreneurial? Success. Execu fu " 

Were rated as more or less ect 

Compared in six motives. n Af and fl 

empirical evidence, it ower, n Autonomy, n Aggression, * 
needs which seemed to 


ri 
as those which best fitted Henry's desc 

nt scores oft е executive Personality. +. study И 
were significantly The hypothesis tested in this 5 80| 
Success in sever] that more Successful executives wou and " 
land defines an high in р Achievement, п Роме, ji 

5 one in which the 


Д 


хес 7 
Pe Autonomy, Whereas less successful TH 
more responsibility for i 


л ation’ | 
cx» wed would have high scores in п Affili "n 
c More individual Aggression and n Deference. ive y 
елу for decisions and their effects,” The choice of the Achievement той ТИ 
[ с) More objective feedback of accurate data ne 
indicating the Success 
b 


in differt? i 
of his decisions » and mu, Ве factors t ie e o А 


ing Successful from | uccessful exe? tio 
‹ entails more risk and io 
challenge in that there į 


his assistance and encour; 


this research. 


j 
:derà ) 
Was based Primarily on three conside 06) 


H ГА 
First, much of McClelland's C199 is a 
[pp. Fesearch has been centered around Ё") 


Е A 

: a 

n honors tive, and he has Shown that there is * 7 
Rela- association between n Achievement 2 не? j 


1 7 lment prenurial success, Second, one o b 
achelor or А а es: qe 
wishes to express pù Major characterization. of the succ ift al 
Douglas Н Powell, {ог ness executive wa. 


5 “achievement be ve 

completing Third, n Achievement had аһеа С ella” 
adapted into а Scoring manual by Mc 

78 
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whic 
a een question of its reliability far 
n 
а, ed characterization of the 
hature of "wes executive involved the 
cessful exec 5 interpersonal relations. Suc- 
а aoa C were described as being 
ordinates ar impersonal toward their sub- 
ties with = l as having broken all emotional 
Bub, gr. нас Whyte (1956) also 
Who is con € successful executive as a man 
not just mU. with “getting ahead" and 
ese two с ting in” It was on the basis of 
Concernin сос анин that the hypothesis 
succes, 8 the relationship of n Affiliation to 
c раз formulated. 
есацѕе Шз motive was chosen primarily 
®X€cutives Henry’s findings that successful 
teased 5, are constantly struggling for in- 
Nobility esponsibility. Whyte refers to this 
Ww ior d as the "executive neurosis"; 
m Ving sa successful executive enjoys 
€ organiz, lily up the power hierarchy of 
à fear o tT or whether he does it out of 
К is the te replaced from below, the 
ere е. 
tem sais п по published research that 
те aining xs relationship of the three 
whyect o Fr cs to business success. With 
i ile ййссевегы Т Whyte suggested that, 
tio tsona] = ul executives have а feeling 
its achment toward the organiza- 
аге е ана successful executives 
i re “out for themselves.” They 


hes ti 

ъа > to the organization and will not 
э ects ub. elsewhere if they feel their 
ra] their cy advancement are too restricted 
Trent firm, This theory was gen- 


t Su 
i major eae by Hagen’s (1959) findings 
tess а tend to have achieved 
О апо Y moving diagonally from one 
in d or even from one occupa- 
уер Who si another; while minor execu- 
ave hel sgn rise above a certain 
up a to progress slowly and 
ТУ states ough the organization. . 
Active that a successful executive 
MS at his E Striving, aggressive person, 
ог str Bgressions are «channeled into 
» U8gles for status and prestige 
Ment, {тану on the basis of this 
» execu was hypothesized that the suc- 
Utives would be low in n Aggres- 


e 
ON 


sion, whereas the unsuc i 
ii cessful executives 
The theory on which the choice of the 
Deference motive was based is largely the 
result of an intuitive deduction on the part 
of the author, although there is some basis 
for it in Whyte's study. Whyte states that 
one of the major drives of the potentially 
unsuccessful executive is to become a part of 
the organization, whereas the potentially 
successful executive, with his well-defined 
self-identity, chooses to remain emotionally 
disconnected with his firm. с 


METHOD 


Sample 

The subject (S) sample and the experimental 
conditions are described in detail in Moment and 
Zaleznick’s (1963) Role Development and Inter- 
personal Competence. Fifty-two business men from 
Boston and the surrounding area were divided into 
The first group consisted of engineers 
rvisors and represented the middle 
on hierarchy. The second group 
d was made up of top 
]| as men in middle management. 


The 55 in the third and fourth groups were 
secured a year later. The members of Group 3 
d so as to fall in a relatively narrow 


were selecte 
age range; 


range of ages and two women. In general how- 


ever, all four groups may be said to fall within 
Roe's (1956) “organization-type” occupational 
grouping. The median age of the sample was 35. 
Median salary ranged from $7,500 to $11,000; and 
the median educational level was "some graduate 
work." These data were obtained through a de- 
tailed questionnaire which each S was required to 


complete. 


Each S was also a ‹ 
tructed Thematic Apperception Test 


a specially construct 1 
(ТАТ). These consisted of four pictures showing 
situations in which business men are obviously in- 

ns given on this test were 


volved. The instructio: п 
similar to the ones employed in the TAT. 


Experimental Procedure 


ion of McClelland's scoring manuals 


A modified versi Cle 
for n Achievement, n Affiliation, and n Power was 
used to test the presence or absence and strength 


of each of these three motives. The description and 
scoring manual for n Autonomy, n Aggression, and 

n Deference were devised by the present author. 
Both Imagery and Need receieved a +1 as they 
do in McClelland’s scoring system. The rationale 
behind this was that Imagery indicated the presence 
of a motive while Imagery and Need (Need was 
hout scoring Imagery) indicated an 


not scored wit! т 
active concern over that motive. Contrary to Mc- 


dministered a written form of 


80 


Ss were not given а —1 for 
and the distinction between 
Doubtful and Definite Imagery was not made. 
TAT pictures (N= 


automatic 0, 


The third category into which each of the six 
motives was subdivided was created by the author. 
Before devising the scoring manuals, 20 of the 48 
Protocols were read in order to obtain a general 
idea of the nature of some of the stories. It was 
discovered at this time that a significant number 
of the stories apparently adopted à somewhat 


192 cards 


he two raters then met to 
and arrived at a 


Pearson C. Cumin 


r 
Nest, the total score of each S was computed f 
each need. The Ss were then divided again Y " 
respective age groups, and the mean score p б 
need was computed. АП Scores at, or gene Fr. 
mean were considered high for that uer 
motive; all scores below the mean were consi 
low. 


Testing the H ypothesis 


i contol OL 
Because the hypothesis predicts the R^ 
influence of each motive on greater 01. ал 
success in business, а one-tailed test of sign! tech- 
was employed in most cases. The шн. test 
nique in 2x 2 contingency tables was used 
each specific hypothesis, 


RESULTS 


t 
The results are shown in Table 1. The f 
hypothesis was that more successful Mu 
tives would have high scores in n At ae 
ment, whereas less successful hig 
would have low scores on this motive. 
value was significant beyond the .01 leve 
confidence, mo 
The second hypothesis was that ore: 
Successful executives would have low Scl 
in n Affiliation, whereas less successful on 
tives would have high scores. The dire. ie 
of the results Was opposite from that W^ a 
Was predicted, Tt js interesting to note ftl 
had the hypothesis predicted that иссе of 
executives would have high scores inste 
low for n Affiliation, the value of ? Y 
have been 15. gue’ 
The third hypothesis was that more s iP 
cessful executives would have high або, б 
n Power, whereas Jess successful exec” sg 
would have low Scores. The р value was 
nificant beyond the :01 level of confidence 


re 
8 


oul 


TABLE 1 


= RELATIONSHIP OF CaREER Success то TAT Моту 
Se SS є 
Motive xi А Hi Motive 

Hi Success 

n Achievement 5.58 01 

n Affiliation 1.26 «308 s 

n Power 6.21 01 ia 

n Autonomy 0.51 325 15 

n Aggression 0.11 E 7 

n Deference 0.01 .50 11 


Ju 


Hi Motive 


Lo Motive 


Lo Success Hi Success Lo Succe? 
5 10 14 
6 14 13 
4 11 15 
7 14 12 
3 22 16 
8 18 11 
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The final three hypotheses relating success 
business to n Autonomy, n Aggression, 
and n Deference were not supported. 


in 


DISCUSSION 


On the two motives (n Achievement and 
n Power) which differentiated more success- 
^ from less successful business executives, 
“ОШ Concerning n Achievement are 
A y the most significant in that they 

Pport previous research. 
assa Clelland's research indicated a strong 
ry between n Achievement and entre- 
anria] "i Success. The term “entrepre- 

ilies Owever, may not be specific to the 
account ат at large. It takes into 

A South У a small portion of businessmen. 
study i ad" of the results of the present 
related 4c atn Achievement was shown to be 
sample of Success in a much more diversified 

of the business population, The results 
empirical validation to Henry's 
Gutives as tion of successful business ex- 
ey indiate. with achievement desires.” 
which 5 ed, however, the limited extent to 

Usiness У 5 characterization of successful 


€xecutivi i 
empi. es bears up under rigorous 
Dirica] validation, P i 


e su ey Я 
опсег Ccessful validation of the hypothesis 


Significant the power motive was considered 
Tesear, h ecause of the lack of any previous 
Dess. connecting it with success in busi- 
relation chi-square showed no significant cor- 
The е п Power and n Achievement. 
the m Provide empirical support for 
SUccegg u vations of Henry and Whyte that 
for increase Ves are constantly struggling 
wings related responsibility. The positive 


À to power s i 
Striy; ver suggest that achieve- 
for que Ving alone is Not the sole criteria 


Merentint: 
Hating more from less successful 


Save 
üracteriz4 


executives. There is also a definite desire, 
on the part of successful executives, for in- 
creased responsibility and control within the 
organizational hierarchy. 

The overall picture, then, of the successful 
executive is one of an individual who is 
determined to maintain a high standard of 
excellence in his work, and to assume greater 
responsibilities and more control over his 
environment as he advances within the 
organization. 

These findings suggest that the analysis of 
motives by means of the TAT has promise 
for executive selection. However, at this stage, 
the practical use of this technique is limited. 
Further research supporting these findings on 
different populations is needed before these 
methods can be validly employed in industry. 
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MULTIPLE-REGRESSION ANALYSIS OF A PAIRED- 
CHOICE DIVISION-OF-TIME INVENTORY IN 
RELATION TO GRADE-POINT AVERAGE' 


PURNELL H. BENSON 


Consumer and Personnel Studies, Inc., Madison, New Jersey 


This paper reports analysis made of a fresh 
type of questionnaire material for recording 
choices concerning use of time. The under- 
lying research aim was to estimate academic 
achievement from the reported choices of 
amounts of time to be Spent upon designated 
activities, 


МЕтнор 


The activities and their descriptions were: 

1. Study on your own: serious reading or study- 
ing beyond assignments given in courses, 

2. Sports Participation: team sports or anything 
you do for the sake of exercise. 

3. Watch entertainment: looking at plays or 
sports, whether on television, at games, or going to 
movies or theater. 

4. Leisure time Teading: magazines, 
fiction, or any other light reading. 

5. Recreation with others: dating, parties, visit- 
ing or entertaining friends, but not merely staying in 
Someone else's home and not group activities whose 
Purpose is sports or watching entertainment. 

6. Altruistic activities: volunteer social service, 
civic or Political activities, or Participating in a 
Philanthropic school activity, but excluding work 
responsibilities or other categories listed here, 

7. Religious activities: attending church, Sunday 
school, devotional reading, or other religious exercises. 
Activities in behalf of a church belong under the 
heading of altruistic activities, 


newspapers, 


The instruction to the respondent was: 
had just 7 hours (or 21 hou 
the following pair of activities, 


1Project supported by National Institutes of 
Health Grant No. MH-10539-01 administered by 
Drew University. The counsel of H. O. Gulliksen is 
acknowledged. Findings in this paper are the re- 
sponsibility of the author. 
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from .28 


ппайї 


The 7 activities Were presented in the questio M 


in the 21 possible pairs. The amounts of time, 3 
divided by the respondent between activi 
these pairs were 7 hours per week and 2 " 
Per week. For convenience in selecting time ; 
double box scale ranging by hourly steps from n 
and 7 to 0 (0 to 21 and 21 to 0) was printe | 
to each pair. 


$ 

10% 

RATIONALE ron FITTING Їтплтү FUNCT 
TO THE DATA 


) 

Marginal utility theory (Samuelson, 19%, 
provides a basis for fitting utility functio” 4 
the data for divisions of time between df 
tivities in the pairs, The usual experienc? t$ 
the consumer is one of decreasing їпсгеп! od 
in satisfaction from added amounts of ere 
consumed. With each added amount of ined 
vision Watched, less satisfaction is оріар of 
until no more TV is watched that evene 
that week. The function which relates the aU 
of the last or marginal increment in sati Du 
tion to the amount already consumed 15 
marginal utility function. it # 

In the analysis of buying behavior, е oí 
assumed that consumers buy quantitl© pe 
each commodity up to the point уне, ob 
satisfaction received from the last uni 5 
money spent upon the commodity is equa 
each commodity, Tf the satisfaction from 
last dollar spent per week upon me? 
greater than the satisfaction from the 
dollar spent per week upon vegetables, 
the consumer will spend more money on Г 
and less on vegetables in order to in¢ 
her total satisfaction. 


i 
jo?! 
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T 
in UR cai of marginal utility functions 
of disposal is to predict how fixed amounts 
Ser e ied income are divided by the con- 
t the eiat opportunities for satisfaction. 
amounts "y of division, the sum of the 
money ibus P spent equals the total 
marginal utili е to the consumer, and the 
rom these ities are equal. Solution is made 
amounts of „ерга relationships for the 
alternative ina ng spent by the consumer on 
i А 
иййу ше P resents the decreasing marginal 
Men су кеа on amounts of time 
ege Student u categories of activity by a col- 
OWs Sui for illustration. This figure 
f equation ically the marginal utility system 
JOéy bet S, Whether for division of time or 
Sidering tien available opportunities. Con- 
Consumer i system from the standpoint of 
Unction, f uying, let the marginal utility 
or л goods be given by: 


Uu = a, + biy 
uz a+ boxe, 


Wh eds bixi 


Un = an + Б.Х. 


e Ws 
^w i ion the marginal utilities, the @’s are 
Nes, the р constants for the marginal utility 
7 are the S are the slope constants, and the 
DR the » оа of money (or time) spent 
op iati n оү portunities for consumption. The 
ds restriction specifies that the sum 
Y. equals a fixed constant Ё. 
TAL ч 
Since ани Ub 
н. ег, the Marginal utilities are equal to each 
yh System includes (m + 1) equations 
het for n) unknowns. Solution is made for 
thee (о € X's which specify the amounts of 
е differ T time) spent by the consumer on 
Supp, "t kinds of goods 
With POSe the 4^. are kno it possible 
are known. Is it poss 


St; is 

ш which system to solve for the Con- 

Sy Us? т, i define the marginal utility func- 
s S if the origin and stretch of the 


are 

Б designa дхей arbitrarily. This can be done 

C ех ing one of the a’s and one of the 
d am- S Must be obtained from two ОГ 1016 


o : 
Unts of money (or time) which are 


Nargiza) tility 


—L. 
House per ves 10 


Fic. 1. Marginal utility profile lines for seven 
activities for case illustrated. 


divided by the consumer, in order to create 
enough data to solve for the remaining slope 
and intercept constants. 

Change of origin or change of scale for 
the system of marginal utility functions does 
not affect the divisions of time or money be- 
tween alternatives. Marginal utility functions 
can be used to predict consumer divisions of 
time or money, irrespective of the transforma- 
tion applied to the zero point or stretch for 
the system. This circumstance makes possible 
an empirical determination of marginal utility 
functions which has apparently gone un- 
noticed by economists. This determination 
would be useful in economics for establish- — 
ing demand functions from consumer pur- 


chase data. 


The foregoing background of marginal 


utility principles indicates what is ааштай 
in the research model for fitting functions to 
reported divisions of time between activities. 
Without prior measurement of the utilities of 
the activities, their function can be postulated 
and solution made for its parameters from 
the data for divisions of time. The underlying 
function is for the total utility of all of the 
activities. This is the function whose partial 
derivatives yield the marginal utility lines. 
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Let it be assumed that this function сап be 
approximated by a parabolic surface within 
the region for the divisions of time. With A 
the amount of time spent upon the ith activity 
and U the total utility resulting from the л 
activities, we have, allowing for interaction 
terms for the dependence of activities upon 
each other: 


bu? 

U = ay t sail dau + 2 
bit? br? 

speres 2 pese 2 + сю 


Ted; dents pos, 


The partial derivatives uw; of this function are 
linear marginal utility lines with simple inter- 
action terms. 


Ui = a; biti + cal + Ciola + ^ Cisl, 


With known values for the 105, it is de- 
sired to define the slope line constants а, bi 
Ci; Ci2,*** Cin. Constants are sought which 
minimize the errors in equating the marginal 
utilities. The expression minimized for divi- 
sions of time /;j, and tix between activities ; 
and j paired from the 5; activities and for m 
s of time А to be divided is (Benson, 
1959): 


inn jon db, 
У x E Clai + bitis + сеа) 
mein 

js 


— (aj 4- 04 + бї) P, 


subject to restrictions described below, 

The differentiation of this expression gives 
a system of equations which can be cast in 
the pattern of a multiple-regression solution, 


TABLE 1 


PATTERN OF ENTRIES FOR MULTIPLE-REGRESSION 
ANALYSIS OF MARGINAL Отплтү Functions 


Dependent Slope co- Interaction Intercept co- 
variable efficients | coefficients efficients 
bi bi b; су а | a 
bik liik 0 0 1 0 
0 lk | —lik | lie — lig 1 E 
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provided certain conditions are imposed. The 
origin of the system, its scale magnitude, and 
(п — 1) of the interaction terms must be 
arbitrarily assigned. These conditions can be 
met by letting a, = 0, b, — — 1, and the 
Cus = 0. Furthermore, the number of param- 
eters remaining must not exceed the number 
of observations of divisions of time, that is ” 
п (п — 1)/2. Examples of lines of entries fof 
multiple regression are given in Table 1. 


ILLUSTRATION ОЕ FITTING MARGINAL 
Отплтү FUNCTIONS 


Data for 1 of the 76 students furnishing replies (0 
the paired-choice division-of-time inventory and e 
whom grade-point average (GPA) and Colles 
Entrance Examination Board (CEEB) verbal pu 
mathematical aptitude test scores are available ie 
given in Table 2. Included is information from er 
Student concerning how he divided his time i 
Week between all seven activities. These amounts, 
time are needed for definition of the interac n 
terms cc, since the amounts of time already wan 
upon the activities not in the pair divided must ide 
known. When the respondent was asked to ore 
time between activities in the pair, he was aske jme 
suppose that he spends his usual amounts of 5 
upon the remaining activities not in Ње pair. 

The lines of entries for the multiple-regres e 
solution used are given in Table 3. The slope со 
ficient for the study interest was taken equal {0 ла! 
and was treated as the dependent variable. Petr 
judgment was used to restrict the number of 3” 20 
action terms to 7, and the total parameters tines 
with 42 lines of observed amounts of time. The with 
of entries were repeated in the table of input cing 
signs reversed to eliminate sign bias in the differe” of 
of the marginal utilities. The exploratory nature ve 
the present study did not appear to justify 2 Tot 
complicated form of least-squares solution than 
Which was followed. and 

The slopes, interaction terms, intercepts ‘ine 
Standard errors of coefficients obtained {ro™ ted 
multiple-regression solution for the case illust? yer 
are given in Table 4. As a check upon the proce? зд 
the utility function was used to estimate the way, oe 
Which the student would divide the amount of уе? 
he spent upon all seven activities between the 595; 
activities. For the case under consideration р 
actual and estimated amounts of time were, in Oy 5, 
of the activities previously listed: (1) 2, 2.9; m 
65 (9) в. 34: (4) 6 53; (s) 5, 48; (6) 5 Age 
(7) 3, 32. For the entire group of 76 students, ел! 
median error in estimating amounts of time 5 
рег week was 2.9 hours, 


sio? 


ESTIMATION ОР GRADE-POINT AVERAGE 


:ons f^ 
The constants of the marginal utility functions fof 
each case were next tested as predictive data у, 
estimating GPA, using all 76 cases in a single 


| 


Div T r Р S 
IVISIONS OF TIME PER WEEK REPORTED BY A STUDENT Б 


SSS. 


A DIVISION-OF-TIME INVENTORY 


TABLE 2 


ETWEEN PAIRS OF ACTIVITIES 


Amounts of time for activities paired 


pon time 
ivid 5 7, i: А РРР 
ided беду Sports Watch Leisure | Recreation | Altruistic | Religious 
your own partici- entertain- ume with others | activities | activities 
pation ment reading 
7 hours ; 5 
= 2 5 
zZ = = 5 es "à E 
3 — e а ^6 : = 
= 1 =a = б pa ш 
= = 4 3 T ш E 
: = Es bs = = 
kd = Е ә 3 4 — 
= 6 = E: EL E 
k = = - 4 = 3 
= 2 — = _ 3 - 
== 5 Е = = 
= Е з = P 4 E 
— B pm e 4 3 
4 3 ~ 4 3 = = 
н = 4 iia = = E 
= 2 aN = 6 - — 
1 = T 4 >a 3 = 
21 hours. = i 3 = = - 2 
== 6 15 12 u siat 9 
== = = kd is 16 Par 
5 = T ^ 16 n = 
= 5 End — = ped 
E = n Uu = m 15 
6 5 — ри 8 13 == 
— = z 16 = Z ES 
==, 5 i == = A 13 
4 oo 17 8 кар 13 
$ = = = Es 16 = 
= 5 = E id zt 
14 
: 2 = _ = 
ыз — 11 sai нч 10 11 
6 15 = 15 6 = = 
6 19 ndn 15 ж 8 — 
es = 13 — = = 15 
n 6 = = 14 F = 
= к. — = = 
28 — == 18 E = Е i 
Я _ 12 
Spent - Ported B 
асцы all 
tivities 7 6 5 s ; 
2 1 к 
Чы 
У А 
тед, тоха i jons were performed with different 
tiple regressio: + 
or iste d ey The marginal utility constants were кыз of variables as estimators to ascertain 
on е m hat in each case the sum of the slope he relative contributions of the groups of variables. 
tudying f correlation obtained are given in 


0; Te » 
Dro J^ Popular activities (excluding $ 


Vig. Own 
y 


t de better Was equal to unity. T 
con asis for comparability 0 


S from case to case. 


his seemed to The coefficients 0 
f the marginal Table 5. These 
of freedom, sin 


have not been adjusted for degrees 
ce their relative magnitudes can be 
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TABLE 3 
LINES OF ENTRIES FOR MULTIPLE-REGRESSION FIT OF MARGINAL UTILITY FUNCTIONS 
De- 
pend- . ` 
ent Slope coefficients Interaction coefficients Intercept coefficients 
vari- 
able 
bi bs bs be bs bs blo | e | en | eas са | e | ee | аз as аа as | в |2 
2|-5 š al 2 a -5 1| -1 at 
= - 5 = | =з 1 
-3 4 5 3 : 
1 -6 5| 3] -8| -e| -3 | -3 1 -1 
$ 4|-3 i Р 5|-s 11-1 1 
E 5 3 
Р „| 3-74 1 3| 3 $| 1| 3] -3 i (ре 
= E 1 _ 
1 ae -5 zu al 
ae 4 р 3 E =I 8 6 3| -1| -3 1 1 
2 -5 ES 5 3|-1 zi 
5 -2 =] =3 | -6| -3| -3 1 -1 “д 
1 
& 3 4|-3 Ре Ei 5| -5| -1 
4|-3 -1 =8 | -1| 2-3] -3 а NES 1 
4 ag 5 zi -3 1 = 1 
-2 5|-5|-s 5 3| -1 
-1 | | А 1 8 $ 3 3 à лү. 
S е = -3 
6| Z3 *| a d s: | 3 E ў 
5 12 ul? a s alal H + ig 
es š 3 
5 не 38 | аа m i ет 
~6 is i 5|—5 ES. 1 
5 3 
8|- 3 -i 
i Ра 18 Ч 8) E зу в { à 1 
= = 1 
-5 аў 24 
8 —13 1| -1 8 6 3 sil 1 
-5 16 =| mg 3 1 
7 ~14 € » 5 3| -1 
-5 = 
11 -10 -4 -1| 26| -3| _3 т eod De ME 
6 | -15 10| —11 zE = 5|-s 1 
13| 151—6 = 1 “5 9| | ag =t ilt i 
-6 x 5 -5 -3 1 к 
-7 ii 151— 5| —9 5 Sl 7 
1 8| 6| 3] 3 1 
13 -8 B lus -3 1 -1 1 
-12 9 i s 8 3 x 
more precisely compared prior to ; ырай d 
The correlation coefficient o i e, еро Constants each separately contribute? vij, 
gression with 31 independent variables would be re-  P'OXimately the same explanation of va ical 


duced to 45 after adjustment 


EVALUATION ОР RESULTS 
While the level of сог 


1. The contribution of 
CEEB mathematical scores was somewhat 
lower than customary, Suggesting that СРА 
used as the dependent variable Was not a par- 
ticularly good measure of Scholastic achieve. 
ment for these 76 students, The opportunity 
for estimating scholastic achievement with 
these data does not seem promising. 

2. The various groups of marginal utility 


CEEB verba] and 


ity in GPA as did verbal or mathem is 
aptitude. Close comparison of small coeffic of 
of correlation which have different degre?. 
freedom is not possible since small coeffic isted 
of correlation cannot be accurately ай ar 
to obtain unbiased estimates of their 282 
tudes. ue 
5. Considerable improvement in the ^. ex 
tionnaire material seems possible. In this jm? 
ploratory effort, only two amounts of nd 
Were given for respondents to divide, ie 
only seven activities, excluding the more ere 
cal activity of studying assigned work, " jf 
given in the pairs for choices of amoun 
time, of 
. 4. Instead of single measures of degr e 
Interest which are provided by usual 1 
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TABLE 4 
==: PARAMETERS FITTED FOR MARGINAL UTILITY FUNCTIONS 
Activity Symbol for Standard 5 Standard error 
cüvity regression deviation RET ER of regression Computed 
тэж соейїсїепї of entry coefficient coefficient T value 
Udy on у 
2 Sports participation bs 2459 — | (-10000) : 
Й ne entertainn ba 9.797 —.1731 .0607 2.852 
5 Rows time uei bs 5.368 —.1409 0595 2.367 
6 Apc ation with ШР n 5.344 = 1792 .0582 3.081 
7 Altruistic actiy se hers bs 4.461 —.3659 0932 3.926 
шош acti ae bs 4.909 —-1493 0615 2.428 
Interaction of 2 ao br 4.862 — 2650 10195 3.333 
qp ttaction of 2 and 5 as — 4295 -2004 2.143 
ditersetion of 3 ena 7 en 1.103 4017 2242 
1Ї°гасноп of 4 ind 5 C35 —.6882 5456 1.262 
qp Taction of 5 аш с —.1684 1356 1.242 
Tietaction ars and 6 Lis —.0697 1464 476 
Te*taction of and 7 Е —.1441 1646 876 
ШШексерг f бапа7 ce — 6120 7166 `854 
ү серЕ f da —4.2023 1.7101 2.458 
Atercent ae 3 is 1.5997 2.8574 .560 
Intercept ce 4 Pi —1.214 1.0235 1.096 
Intercept К 5 = 6.4779 4.5123 1.436 
тесер И 6 E. — 1689 2.2632 075 
Atercept Sa 7 a — 1860 2.8025 066 
= 1 E (:0000%) 
S Vae 9-1 
of 10000000 was assi e iable. 
Wes p o aaie qe Чы depen dert у on vour own” 
» the 3 r Р 
a e lines. RUM utility inventory provides cates strong and y po J ee 
асу; Owing h ire f rofile line has a steep › А Е 
addeg Vity cha ow apparent desire for Рї©. dues A profile line with 
n : x Jine in interest. A prone 
с ges with the expenditure ui gH E t and a falling slope would 


* big, “mount 


3 of time. If the profile line has 


er 
“pt and a small slope, this indi- 


a low intercep 


manifest the least interest of all. 


TABLE 5 . 
MULTIPLE CORRELATIONS OF MARGINAL бшу (MO) VARIABLE 
wirH GRADE-POINT AVERAGE ( 
Vex 
$ 7 inter- р 
Б і i No. inde- | Correla- 
Ekg | Math |7amounts 61248: | 7 slopes action sEof | (SE of red reet 
CEER | of time | CPS of | емо | terms ZEE ITE |S 
М: Per week MU func- functions MU func- 
pe tions tions 
^e RN 
1 2 
| x 1 15 
И 2 28 
7 33 
à 6 25 
x 0 39 
х : 1 38 
_ x A 2 24 
: х = 22 56 
: х x x > > 29 67 
X х x X x x 2» D 
“Nog x x Е x 


adi 
ius 
teq for "e 
ees of freedom. № = 76 cases. 
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The accompanying Figure 1 shows the pro- 
file lines for the seven activities in the case 
Which was illustrated. These are lines which 
show the decreasing interest with each added 
hour per week given to the activity. In the 
terminology of economics, these are marginal 
utility lines. The intercepts were calculated 
on the assumption that usual amounts of time 
are spent per week upon the remaining ac- 
tivities. The usual amounts are the amounts 
estimated from the utility functions, rather 
than the reported amounts. The horizontal 
line shows the level of utility experienced at 
the last or marginal increment of time spent 
upon each of the activities. These details of 
motivational structure may assume future 
importance in clinical Studies of academic 
achievement or in student guidance work, 


(Continued from Page 77) 


Relationship between Family Backgrounds 


and 
Work Values: Frank Т. Paine*, Donald R. 
Deutsch, and Rodney A, Smith: Department 


5. The standard error of estimate of ы) 
individual functional fit is опе of the Pa 
dictors of achievement. The respondent M. 
tells a consistent story about his ai. 
raises the rating made of his future P 
Íormance. This circumstance may imace d 
spondents to report their interest more t 
istically since they will increase their р ‘al 
tion score. This feature may be usefu | 
gaining more valid information as a ee | 
student counseling, as well as for predi 
work. 


REFERENCES 


sons DY 

Benson, Р.Н. Defining marginal uulity functions | 
means of discriminant function analysis. 4” 

Psychologist, 1959, 14, 398. (Abstract) ; 

SAMUELSON, P. A. Foundations of economic в 

Cambridge: Harvard University Press, 1953: 


(Received March 23, 1966) | 


ual | 


| 


‘ 


| 


n 
Auditory S-R Compatibility: The Effect ni | 
relevant Cue on Information Process A atl” 
Richard Simon* and Alan Р. Rudell: "yoy 
ment of Psychology, The University 0 1 
Towa City, Iowa 52240, à syst 
Feedback in a Complex Multiman-Machine am 
Irvin L. Goldsteim*, Jack F. Southard igi 
David A. Schum: Department of Psy Man 
University of Maryland, College Park, 
land 20740, ivity P 
Influence of Interpolated Periods of Ac тете, 
Inactivity upon the Vigilance Deren d | 
William Bevan*, Lloyd L, Avant, ава, nt at | 
Lankford: Office of the Vice Preside И А 
Provost, The Johns Hopkins University» 
more, Maryland 21218. 


Journal of applied psychology 


Vou. 51, No. 2 


APRIL 1967 


ON THE ASSESSMENT OF POTABILITY ' 


RON 
ONALD C. DILLEHAY 


Техас 
as Christian University 


WILLIAM H. BRUVOLD 


University of California, Berkeley 


лхо JACOB Р. SIEGEL 


University of Pittsburgh 


Potability, the 
Ceptualized and 
domestic water. 
Studies utilizing 


acceptance of water 


3 


Tüünfiv: dorsi 
ity drinking water. A theory 


Water wa Е 
4 was briefly outlined, and the recomme 


DSi 
1 H а 
n domestic water was discussed. 


Th 

Cre ; 

ne 15 an ur 

Used "ds i need for the develop- 

of y, » objectiven procedures that can be 

Brot intended d determine the potability 

to ta? & Knuts or domestic use (Ongerth, 

бу; Accepta] son, 1964). Potability refers 

шде "225 of water for drinking 

у efiniti Р 

The ough inition, then, it must be 
Ч " human response to water. 


aris S. 
pes of how potability can 
defined and assessed, ап 


S a 
и : 
ms 


ору, Two research strat 
Psych 


MN Пе dedos ы attack these 
аы Рзусһор, 5, the traditional арргоасһ 
“tes a methods for scaling the 

Wih ® Sociaj 7 Jects. The other approach in- 
Psychological research that deals 


lemse]vo A 


Voly, 
tabil; 
ilit 
ot " bs existing community water 
togram 8165 have been developed 
Чаду į of research of which the 
d à part. 
S i + 
Starch Ocial-psychological approach 
D rn 
a gi ed їй dhie paper w 
al Rescarch Support 


as supported 
rant from 


Мы In 
io, Da Sta 
Ung? of tt hy ate Department of Public Health, 
leq Wa Contra h 
Bun? Барр EE BERI with the Di- 
55 Pbly and Pollution Control of the 


€ Health Service. 


for drinking purposes, 
studied through the asses 
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Solved solids (7 YE ju d 
to be pm (TDS) in drinking water. К 

.82 and higher. The hypothesis Wa 
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may be con- 
sment of consumer attitudes toward 
eveloped and tested in 6 community 
bility is 2 function of the total dis- 
eliabilities of the scales were found 
s strongly supported by the data: 
ersely related to the TDS in com- 
attitudes toward taste in 


consumer 
{ limiting standards for 


ndation 0 


potability necessarily in- 
t of consumer reaction to 
munity water, it falls 
within the domain of attitude research. In 
general terms the concept of attitude refers 
to beliefs or feelings focused on some psy- 
chological object. Taking the attitude ob- 
ject to be the community water, appraisal of 
beliefs and feelings about it, or the attribu- 
tion of evaluative characteristics to it, con- 
stitutes а method of measuring potability. 
This report describes the construction. and 
evaluation of three scales designed to assess 
consumer attitudes toward domestic water. 

Tt resently appears that a major deter- 
minant of the potability of water is its dis- 
solved mineral content. Minerals commonly 
found in water used for domestic supply in- 
clude calcium, magnesium, and sodium cations 
in combination with bicarbonate, carbonate, 
chloride, ог sulfate anions, These minerals 
can produce taste, but not odor, in water. 
Mineral content in water is conveniently 
measured in milligrams per liter, and the total 
mineral content in water may be expressed 
as milligrams per liter of total dissolved solids 


(TDS). 


to the study of 
volves an assessmen 
the taste of the com 
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TABLE 1 


S AND О VALUES FOR ITEMS SELECTED 
FOR THE GENERAL ATTITUDE SCALE (GAS) 


Item 


1.17 | .66 | I would refuse this water even if I was starving 
and thirsty. cni 

1.43 | 1.86 | If I had a chance I would move out of this area; 

lam just sick and tired of this good for nothing 

water. > 

1.80 | 1.35 | I have never experienced water as bad as our 

present supply. К 

2.04 | 1.69 | I have a number of complaints about our 

I think the quality of our water is mis 
The water is very bad out here, 
2.15 | 1.80 | I would not advise anyone to use our present 
water. 
2.69 | 1.29 | The less I use our local water the better T like it. 
3.18 | 1.80 | I just can't seem to get used to our water; it still 
is unpleasant to me. 


ater; 
able. 


4.03 | 1.61 | The water supply in our area is not too good; in 
fact we have had some problems with it in our 

home. 

4.46 | 1.56 | We could use a better supply of water around 
here; the water we now receive is not as good 

as it should be. 

4.53 | 1.53 | Our water would be all right if it weren't for a 
few disagreeable things connected with it, 

ur water is all right, but I would rather use a 

different source. 

5.24 | 2.00 | The local water supply takes a while to get used 

to; besides this, the water is all right. 
5.80 | 1.43 | Although the quality of our water is nothing to 


rave about, I can't point to anything really bad 
about it. 


5.89] .84 | The water in our area does not 
very good or very bad. 
6.41 | 1.50 | I really can't. criticize our local water supply. The 
water is not bad and I have no complaints to 
make about it. 
6.71 | 1.60 | It's just ordinary water; there is nothing wrong 
with it at all. 
Having considered all the things about our water, 
ink the water which we receive is pretty 


affect me as being 


air. 
7.92 | 1.88 | Our water is quite adequate; I use it all the time 
and like it just fine. 
8.77 | 1.57 | I use our water a lot and enjoy it. 
From what I can see our water is very good. 
9.54 | 1.83 | Water is the Breatest bargain we can get; it isa 
Pleasure to use our present water; [ have no 
problems with it. 
10.00 | 1.31 | It is a real pleasure to get such good water, 
10.33 | 1.34 e quality of our water is perfect in almost 
every way, 


It is conjectured that potability is inversely 
related to the total amount of dissolved 
mineral content in water (TDS). The present 
research was designed to provide a test of 
this notion and to evaluate the reliability of 
the attitude scales developed. Specifically, the 
research was designed to test the hypothesis 
that positivity of measured attitude toward 
the community water and amount of TDS in 
the water are inversely related. The specific 
prediction makes possible an evaluation of 
the notion regarding potability and mineral 
content and also the construct validity of 
the attitude scales. 


ments with their scale and О values are Р 
in Table 1, 
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SCALE VALUES AND О VALUES ror ITEMS 5 


METHOD 


Construction of the Scales 


4% 
Thurstone judgment procedures were use 


Construct three attitude scales (Edwards, E 
One scale was designed to be a measure of ш, 
attitude toward the water, not specific to lo 
The general attitude scale (GAS) was de rd 
from 73 statements, which were constructe 
letters of complaint about water supplies sere 
responses to an open-ended question adminis nto 
a survey by the California State meat 4 
Public Health. The statements were eee ni- 
subjects (Ss). Some Ss were students from ‘rement 
versity of California fulfilling a class гей болі 
Тһе remaining Ss were employees of the der 
State Department of Public Health who volu m 
to serve as judges, The judgments ЖУ ш” 
Оп an ll-point scale ranging from 1 (hig! 
favorable to the water supply) to ba 
favorable to the water supply). On the wert 


from 
d ій 


ighl¥ 
11 hes il 


ts 
mean judgments and Q values, 25 ee state? 
selected to comprise the final scale. Т p. 


th 
А #0 

с , 
Тһе second scale constructed was specifi uc 


: in cons 
taste of water. The 95 statements judged in = w 
tion of the attitude taste scale (ATS) we 


dra 


TABLE 2 


FOR THE ATTITUDE Taste Scare (ATS) 


Q Item 


Р an 
1-13) .62 | E would never drink our water under 


ШАП 
in MY hat 
1.65 | 1.64 | I have never tasted such foul water in d: th 


presan abo! 
2.16 | 1.26 | The taste of our water is bad in just а jov 
zind we 
2.47 | 1.61 | Bad tasting water, such as the kind з 


2.78 | 1.56 | I certai 
3.36 | 1.88 | The агіпі 


able taste. yel 
4.33 | 1.30 | Our water seems to taste a little bad: ае give а 
4.81 | .96 | There is something about our water p 

a mildly unpleasant taste. taste 0 
5.00 | .69 | I am slightly disappointed in the 1 

water which we are now getting. . jt cou 
5.29 | 1.72 | The taste of our water is not bad; 


y ке the 

5.87 | .81 | I can't decide whether I like or dislik ой 
1. 1! 

6.00| .65 | The taste of our drinking water is пе 


ou! 
6-42 | 1-55 | I have no problems with the taste of 
1:67 | 1:37 | The taste of our water seems goo. 


m N^ 
&17 | 1-57 | I drink our water a lot and enjoy it. "c 
8.89 | 1.60 | I find our drinking water to be very п we 
9-18 | 1.58 | We're lucky that the taste of the wa 


9.82 | 1.41 | Our water tastes especially good. 
10.34 | 1.22 The taste of our water is excellent. | m 
10.57 | 1.20 | The taste of our water is perfect i 


m 
y circ 
dap 
ай 
stances, 


at T^ 
Our drinki 


П: 
E water tastes во bad th 
Stand to keep it in my mouth. 
951 1.17 | The taste of our drinking water is во D^ үе? 

| CQuld only drink it in an emergency үе 

n 

way. are 
getting, should not be tolerated. agri 
inly hate to drink our к, кш 
king water around here h 


etter. 
of our water, ег 
al 
nor bad. rw 


ur water will not harm anybody. 


, fait 
3 y 
The taste of our drinking water is Р! 


rett: fof 


nave 
Our water tastes good. I am happy t 
my drinking water, 


very good. Л 
LÀ 
very 


———————— 
p grams E 
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from th 
е sam 
€ sources as those for the GAS, and 
AS, 


е same 
Procedures 4 
А the scale. the and Ss were used in construct- 
Wn in Table 2 items selected. for the ATS are 
ird scale. ; 
nstructed Fh Specific to the taste of water 
j e. опей ia 103 adjectives taken from the 
‘ 5 and раа and scaled by the same 
with lective А с adjectives selected for 
ir scale aste scale (AA 
ale and 1 a (AATS), along 
values, are i 
The Inte . О values, are shown in Table 3. 
rutew 


in 


со; 


"T. 
Severa Dürview yy 
Previog Questions 
Unst S Water ex 


Тым which contained 
Бейен ength of residence and 
Valuatio, *d question ce, and also contained two 
is n ^ S dealing with the respondents 

Was si bout the ее ыы water. One was а 
water in general, and the other 

avorable, peus verbatim and then 
with r Purposes ш, and unfavorable 
Тее respo comparing attitude scale 

nses about the community 


lif, 
ы Шога 
tow: 
ns were selected as sites for 


or 
intone characteristics of the 
dates to one major factor 
е Wn s of potability—total 
Uno Der Ji 82, 38g 133 supplies for these towns 
ant te Per of igit То апа 1401 milli- 
Dro, Vater OUEhout о S. The TDS levels were 
à ae community over the year. 
е уле, had a record of odor 
оттоп aes dissolved constituents, 
precable oe judged capable of 
т 9cedure, er 
MT Ong Мас аба and circumstances of inter- 
ые with ™munity to ation varied somewhat 
d. Vom communities another, but were con- 
sq de Middle; ected on ү Respondents in Town 
кыЛ Со the basis of house numbers 


Ct, -lo А 
ч Чё] d w- 
pq ү їп Tow, middle economic area. Re- 


еа 


atp hoy, Y E i 

NO "s nup dified b. again all women, were 

PNIS p les bers, x Sampling on the om 
У interview and Шеп the 


Vere 

admini 
Uni a dents in ministered in the respondents’ 
Morey wally of both towns were told that the 
of My, line o Tra opinions about their 

зат 
^ Dling procedures were used in 
or 3n er, E. A detailed account 
the dta T 919, ipi. methods has been given 
bg аа ды Cees uu In each community 2 
NNNM кедү S randomly selected from 
ed toy, ^" Ces to ee was then made © 
i orm a pool of respondents 


Ay hi at 
qet га е$ 
956 thad Poñdents were subsequently 
to 9E th SPondent each pool. Eighty-eigbt 
nts selected from Town 


sel 
st "ni from Towns A, С, an 
(а local school) and Pàt- 


TABLE 3 
SCALE VALUES AND О VALUES FOR ITEMS SELECTED 
2 ATTITUDE TASTE ii 
Scare (AATS) 


Scale 
value Q Adjective 
1.24 92 horrible 
1.36 1.23 sickening 
1.43 1.32 terrible 
1.68 1.09 disgusting 
1.78 2.15 unfit 
1.94 1.33 awful 
2.09 1.48 good for nothing 
2.11 176 bad ы 
2.46 1.68 undesirable 
2.60 1.91 disagreeable 
2.71 1.90 unsuitable 
2.87 1.65 unpleasant 
3.14 1.29 poor 
3.54 1.51 inferior 
3.72 1.53 dislikable 
425 1.51 below par 
4.92 1.29 can be tolerated 
5.95 148 passable 
5.97 1.52 not so bad 
5.98 88 fair 
6.09 .60 average 
6.10 72 ordinary 
6.26 1.04 O.K. 
7.94 1.38 likable 
8.04 2.0 fine 
8.23 1.82 preferable 
8.29 1.75 appealing 
8.63 1.82 tasty 
8.78 145 good 
9.19 2.08 desirable 
9.45 174 enjoyable 
9.96 1.94 great 
10.00 1.99 delightful 
10.57 1.60 delicious 


icipated in the study. Respondents Were given the 
GAS, ‘ATS and AATS, in that order, as part of a 
"sisting also of the interview schedule and 

involving water samples. 

j attitude scales e interview and pre- 
Tac ical task. The relationship be- 
es and psychophysical re- 


tween attitu a 
sponses will be the topic of a subsequent report. 
RESULTS 
cales 


Reliabilities of the 5 
To assess reliability of the scales specific 
to taste, the correlation between ATS and 
AATS was determined assuming that these 
were equivalent forms of the same scale. The 
Table 4 presents these correlations 


first line of 
separately by community and for all six com- 


R. C. Ditrenay, W. Н. BRUVOLD, AND J: P. Steers 


TABLE 4 


CORRELATIONS AMONG THE ATTITUDE 


CALES AND UNSTRUCTURED INTERVIEW QUESTIONS 


Е те —À 
| Community 24 
Ы | | Y. Combined 
A | B^ | nis T4 
(N = 49) | (VN = 19) | (у = 
| r Ww 
225 
ATS-AATS | 293 83° | a 75 
ATS-GAS | 91 E 38 326 
AATS-GAS | 91 | 86 | n : 
z 2 
ATS-GOE 59 | 69» | 84s 62 6% Jl 72 225 
64 .69 ER .68 63 38 13 225 
2 | 32 | а>» 32 з | @ 79 i 
| | | 142 
3E TR т | 145 
63% | 77а | 72s | 145 
66% 73а T | ) 
| " 
GOE-TOE 65 | 71а EE | | bil 


Note.—Abbreviations: 

E = open-ended question 
specific to taste. 

з Based оп № —1 cases due to one incomplete scale. 

» The open-ended question specific to taste was not 


attitude taste sca 
about evaluation of wa 


munities combined. For five of the six com- 
munities the correlations were -92-.95. The 
correlation for Community B, 83, уу 
the others but still substantial. 
Given the high reliabilities of the ATS and 
the AATS, the correlation between either of 
them and the GAS provides a means of esti- 
mating the lower boundary of the reliability 
of the GAS. The reasoning for this is as fol- 


as below 


asked in these communities. 


lows: 


for the reliability of the GAS. 
That is, 


TABLE 5 


REGRESSION ANALYSIS n 


ttitude taste scale; GAS = дене, 
open-ended question about evi 


assuming for the purposes 
limiting case that the true correlation 
the GAS and the ATS is 1.00, aps 
for correction of attenuation can 


w 
яр о 50 
1 attitude д 
luation © 


ти 


a 


for! 
solv 


; (гр5) 7 
ETWEEN ATTITUDE TASTE SCALE (ATS) AND Toran DISSOLVED sous (UZ 
Town A B C D E | с 
E 01 
TDS 50 82 388 1,140 1,194 M 
N 49 18 43 38 51 588 
М» 8.02 182 1.59 6.16 6.90 1.89 
SD 0.96 121 119 2.06 177 EM 
Source of variation SS df MS à 
89° 
Linear regression 109.53 1 109.53 1.98 
Deviation of means from line 19.01 4 4.75 ot 
Between-array means 128.55 5 25.71 us 
Within-array means | 513.85 214 2.40 
Residual from line | 532.85 218 244 
Total 642.38 219 


^ Higher means indicate a more fav. 
* p <.001. 


orable evaluation of the water, 
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TABLE 6 


REGRES 
EGRESSION ANALYSIS 
ION ANALYSIS BETWEEN ADJECTIVE ATTITUDE T. 


Torar DissOLVED SOLIDS 


ASTE SCALE (AATS) AD 
(TDS) Mi 
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"еллы... 
TS M di "E 
TDs | > | С | D | E " 
N 50 E i r 
Ma 49 82 | 388 | 1,140 1194 
› 19 43 ш 38 | 05 1,401 
SD 8.01 аб m 38 51 of 
Di | | 1.56 $86 | 6.73 Ec 
| 1.41 1.20 2.25 541 
Source of — - > 182 1.83 
ce of variation SS d MS 
Linear = ki F 
AT Tegressior 
USOS ша 160.77 1 77 57 
Seri means from line 26 21 1 | E 57.01* 
Vithin.ar, Tray means 187.20 | 5 | 37 41 2.39 
Residual fo. means | 59209 | 315 | x pee 13.61* 
Tot: from line aoe ei) 2.79 
Se al ыт | 219 | 2.82 
‘Higgs 779.29 | 22 
* p < фур Сапз indic 8 = = 
` ate a more favorable evaluation ot the water. 
Whe 
Te: 
fo ur 
r thi с = esti : 
betwee v mated reliability coeficient water. To the extent that this is true, the 
the Na the G AS — the obtained correlation reliability of the GAS will be higher than .82 
torg ТАБ and the ATS: and rrr = because of the reciprocal relationship betw 
elati Y of the A TT : p een 
on b TS, taken to be the the correlation between the true scores and 
the reliability of either scale. 


ly Plicatiog о 


lo, ound 

Mate 82. In = the reliability of the GAS 

ео ће lon ipn is a conservative esti- Responses 

sen ha b onus bound of the reliability The correlations between th 

a be те GAS . the true relationship be- and free responses to unstructu 

ther ucl sin and ATS would probably can be seen in rows four throug 
ce the GAS measures factors Table 4. The relationships fo 

munities combined were all in the 


etw 
WEED ATS and AATS. 
this formula indicates а 


he ey | 
aluation of the taste of the 


Relationships between the 


Scales and Free 


e scale scores 
wed questions 
h nine in 


al com- 
‚7035 even 


TABLE 7 
ERAL ATTITUDE SCALE (GAS) AND TOTAL DissoLvED SoriDs (TDS) 
e D E F 
388 1,140 1,194 1,401 
“43 38 51 21 
7.49 5.65 6.61 526 
1.26 199 178 199 
| e 
SS df MS | Е 
De? regressi 2 еза 
ection of uod 1 72.66* 
Wig array mes from line 4 3.05* 
: Resin rarray n means " 5 17 49** 
7 "ro Чаї fro neans 215 
т К tal m line 219 
sli | | 230 | 
feels SP ie с | oa 
" ion of the water. 


S. 


p ans inq; А 
01> 01 dicate a A 
и - à more favorable evaluat! 
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though only three coding categories were 
used for the open-ended questions. These 
data show that the scales had considerable 
variance in common with evaluation of the 
water in the respondents? own words. 


Validity of the Scales: Potability and TDS 


Regression analyses based on the data from 
all six towns were performed to determine 
the relationships between the attitude scales 
and TDS. These analyses are presented in 
Tables 5, 6, and 7. In all cases the differences 
among means for the different communities 
were significant beyond the .001 level. Ad- 
ditional tests show the linearity of relation- 
ship to be highly Significant in all cases 
(№ < .001). In only the case of the GAS was 


there significant (5 < 05) departure from 
the linear-regression line. 


Correlation coefficients 
tween TDS and ATS, AATS, and GAS 


were —.41, —.45, and —.50, respectively; 
the corresponding etas were 45, .49, and .54. 


(Pearson r) be- 


Discussion 


The high intercorrelations among the scales 
indicate that a very satisfactory level of relia- 
bility was achieved. It is well to note that re- 
spondents from the six towns were, because 
of the sampling methods employed, extremely 
heterogeneous in age, ed 


ucation, and other 
characteristics. Thus i 


This result 
at potability 
neral content 


in domestic water, and it also supports the 


validity of the scales constructed to ше 
consumer attitudes toward the taste 0 
mestic water. m... 
It should be noted here that socia? 
chological theory and research indicate К 
individual attitudes may be determin qu 
a number of factors, and that they are a 
the result of considerably more hase: y 
physical or “objective” characteris ug 
attitude object. The attitudes of in moni 
consumers tóward the taste of the "E 
water, then, should be determined 
physical characteristics of the water d 
factors as well. A theory has recent У i 
developed (Dillehay & Siegel, 1966) 7 yj 
outlines in some detail possible сан dr 
of consumer attitudes toward taste unt 
mestic water. The theory involves A ї 
tional view of attitudes that owes : T 
previous work by Katz and обе тй 
Katz, 1960; Katz & Stotland, 19855 it y 
1961; Smith, Bruner, & White, " facto” 
broad strokes, two general classes 0 со? 
are seen to affect attitudes toward cial Р“, 
munity water: psychophysical and 50 i avi 
chological. Psychophysical influence? jon И 
the experience of the water as а ош P 
its physical characteristics (еә пе alg, 
solved minerals, gasses given ofi d 0 D 
and the state of sensory mechanism ей?” 


о 
= = 


т 
th "i 
m i th 


The magnitude of the correlations 2. E 
TDS and attitude scale scores four if 
present research, while statistically pu me 
and potentially useful for predicti"? sg v, 
attitude scores for communities, indict ee 
а considerable portion of the RISE Tf, 
Score variance was unaccounted for. p ri 
Since mineral content was the only i" in E 
taste-producing physical constituent йү! 
waters studied, the magnitude of the 


Correlations suggests that sensory АЛ 


= 

в. 

4 
Ss. 
a 

Е 

E 

— 

o 

ga 

a 

= 

@ 

= 

o 

> 

р 

c 

= 

= 

Е] 

©; 

uo 

З 

[^ c Е 

ee 
A —— 
i c СЕ к Инын 


ASSESSMENT OF POTABILITY 
95 


Psychologi ? P 
tosien аб tors just discussed produce 
hose senso aviation in attitude-scale scores. 
ables that ек, and social-psychological vari- 
d ИЕ to assessment should 
ealing with th y measured in future surveys 
ent and ter I elation between mineral con- 
the согу ility in order to provide a test 
Ment of a just proposed. The measure- 
recommending variables will also aid in 
Omestic Wir an upper limit for TDS in 
or dily drinking order to ensure potability 

Upper lim; А 

m S» pang for total mineral content in 
co nàble ы һе recommended. with 
à ducteq as idence if, in future surveys 
te в dee Towns A, C, and E and 
a systems m number of community 
un attitude-tast e relationship between TDS 
Psyche or ‘iene scores turns out to 
hin; ogical vende and sensory and social- 
nants of attitude toward 


Cor, taste j 
lo ated Wilh water are found to be un- 
dij, ° Pans TDS. Given linearity and 
lip al deter ation between TDS and ad- 
deter 01 g mars of attitude, an upper 
бан ined ftem. domestic water could be 
THe relatin the univariate regression 
g mean attitude scores and 


set p, The 
bY the "e limit for TDS would be 
If th € limit шк score defining the 
tude Telationshi potable domestic water. 
qe taste-s ip between TDS and mean 
У Занг scores departs consider- 
c ae upper limits for minerals 
n Whitltivariat might be recommended 
18 Btedigg СА Sepa е linear-regression equa- 
о ein СОР Yáziables ionic constituents serve 
Unities tw If mean attitude scores 
lvariate т; not deviate significantly 
inearity, and sensory an 


Usin, esti 


social-psychological determinants of attitud 

did not correlate significantly with any of de 
several predictor variables, upper limits f x 
the several ionic concentrations would d 
be established by the mean attitude s 
defining the reasonable limit of potabl Е 
mestic water. If, however, аана. a 
relation occurs between sensory Or Si E. 
psychological determinants of tees oe 
one or more of the ionic constituents, or i 
TDS in the simpler situation, the relation be- 
tween amount of mineral content and meas: 

ured attitudes would have to be accounted 
for, separate from these other factors, before 
upper limits for minerals in domestic wate 

could be accurately recommended. : 
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DRIVING RECORD OF NEUROPSYCHIATRIC PATIENTS’ 


MATTHEW W. BUTTIGLIERI 


Veterans Administration Hospital, Sepulveda, 
California 


The driving records w 
Vehicles for all patients admitted 
Sepulveda (California) Veterans 
licenses in their possession. The 165 
records which did not differ signi 
population. 8052 
had no more th 
tion. There was no clear-cut 
between the patient group and t 
at the high end of the point-cou 
patients. 


In this highly 
of transportation 
handicap to the w 
lation centers wh 


mechanized age the lack 
can be a serious economic 
orking individual. In popu- 
еге public transportation is 
less than adequate, the individual is forced to 
depend upon the automobile for crucial 
aspects of his livelihood. In few sectors of 
our society is the lack of transportation more 
vital, socially and economically, than in the 
rehabilitation of the recovered mental patient. 

Understandably, most authorities are re- 
luctant to deprive the individual of the driv- 
ing privilege. At the same time, the identi- 


fication and reduction of high-risk automobile 
drivers isa growing con 


а of deficient driving 
skills. Some require the applicant for the 
driver's license to answ 


8 conditions, for 
hess, epilepsy, dizzy spells, 
Few, if any, have a Systematic 
heck upon the veracity of the 
determine with certainty the 


estigation con- 


example, mental il] 
paralysis, etc, 

procedure to с 
answers to 


1 This study is Part of а 3-vear invi 
ducted by the Institute of Transportation and 
Traffic Engineering in conjunction with 
Sepulveda | Veterans Administration Hospital 
ported by a research grant from the Accident 
vention Division of Bureau of State Services, 
partment of Health, Education and Welfare. 


The authors gratefully acknowledge the coopera- 
tion of the Western Research Support Center who 
helped with the data Processing and statistical 
analvsis. 


AND 


еге obtained from the C. 


to 


Administra с 
-Patient sample had accident and violation 
ficantly 
of the sample had no accidents and more than # 
ап 1 driving violation during the 
difference 
he California male driving population except 
nt distribution for a very sm 
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MARIE GUENETTE 


И Trafe Enginccritb 
Institute of Transportation and 1 ИД, oe 
University of California, Los Angele 


alifornia Department of Motor 
the neuropsychiatric wards oí the 
tion Hospital with active driver's 


from the California male driving 
of the sample 
3 yr. preceding hospitaliza- 
іп negligent-operator point count 


all proportion of 


tiv? 
presence or current status of the presump | 
high-risk condition. "EPI 
The literature is full of studies 0 wi 
human element in driving, and many m 
psychological characteristics found to ho? 
lated to accident susceptibility x 
which one would expect to find € | 
in the psychiatric patient. o y* 
ously enough, there has been no § eren 
driving characteristics with special << ША 
to the mental hospital patient. ye i 
lack of hard data, the individual ingle’ 
history of mental illness is uniquely үй 
Out for specia] Scrutiny where the 
privilege is concerned, nfi 
It is common hospital practice to СО ers ч, 
the driver's license along with other P e 
belongings of the patient at the m M 
mission. Lamb (1959) has cited cas ut WI 
lustrate that latent tendencies to act © сой 
the automobile тау be activated bY of pg, 
situations generated during the am. th 
chotherapy, and he recommends d б, 
therapist should take action to fores 17 
Occurrences of accidents in therapy. rta 
danger of accidents becomes an "s ho. 
consideration in the management of ques 
Pitalized mental patient when the m vis 
of passes, night hospitalization, us n 
etc., comes up for decision by ue tion 
teams. АП too often, however, He inal 
and the decisions are made indiseri™ 
because of the lack of relevant data. zl 
The patient who is unable or unwi 


quat? 
im 


$ 


dr 


seati 
yt! 


| 
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0 
inf 
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NG ЕСОН КЕ 5 / ATIENTS 


TABLE 1 


CHAR 
ARACTERISTICS OF PATIENT SAMPLE 


Characteristi | 
асїегїзї |Е 
Age ic | Frequency | Percentage 
Pader 25 
= 6 3.63 
Е 36 21.81 
т m 38.18 
T А 26.06 
; 3 24 
75-84 | " 
8 4.84 
S 0 о 
Median = 3209 | | 
Маш паре = 40.75 
` pse 
Married А 
Writtted ү 
p; Wed б 
Sex Worced М 
Ма тасе E 
Mate White 
Male Negro E E 
b Female t Stated i is: 
ign “i " » 
m 10 6.06 
Poy p Dhrenic 
Chto tic disorders (other) 10 
Ae E er 
p7 ai un syndrome n 
on Onalit Tate disorders is 
tha, ^ ty disturbance E 
Ne e | | 
9 


Wai 
16 
the „ the f 
n avor n 
аш е able decision with respect to 
hospital 


rn 
lo»: Of hi є 
cavities i driver’s license by 
a licens? take ih veral alternatives. He сап, 
" 
S he chance of driving without 


Т espi 
ure ET the potentially serious CON- 
pii ins pegs patient learns to 
Ome > Privile elf the convenience of the 
ong, Sr With. by leaving his license at 
Nally Cation i a relative thus avoiding its 
ашы пе шшш hospital admission. Fi- 
ang th бб edgeable patient сап, at the 
"n eic Bin a report his license a5 lost 
fee is himself E replacement at modest 
loss а serious or those instances where 
ү Pho drive. a question of the patient's 
з wi s Seems Some tightening ир of these 
wre holding in order. However, since 
the mou | ng of the drivi ivilege can 
in Dati Serious КЫ priv! ege a 
thy 6n s economic repercussions ОП 


is and hi : j 
area sh his family, recommendations 
ould be made only after the 


most careful study a ishi 
practical set of s ERNST UEM 
Тыз study, which is part of a 3-year i 
vestigation of the effect of drugs on skills i 
lated to driving, examines the driving rec d 
of the neuropsychiatric patient and how КР : 
relate to comparison groups. "т 


METHOD 


The subjects (55) of this study i 

tients admitted to Edel. Aa s Ие 
Sepulveda (California) Veterans Кашан ЕШ og 
pital from August 1964 through July 1965 AU 
those patients with active California dive E 
licenses in their possession at the time of айыы 
d for inclusion in this study. Identiiy- 
infor n from the licenses was sent to the 
California Department of Motor Vehicles on ihe 
Driver’s License Information Request Form. Th E 
forms were subsequently returned with н 
information with respect to the record of acidente 
and violations in the 3-year period immediately 


preceding hospital admission. 


were considere 
ing informatio! 


RESULTS 


A total sample of 165 different patients 
ollected. This represents approximately 
psychiatric admissions for 
d of the study. Table 1 
arizes characteristics of the patient 
ms of age, marital status, Sex, 
The Ss varied in age 
a mean age of 42.1. The 


was C 
29% of the total 


the 12-month perio 
summ 
sample in ter 
race, and diagnosis. 
from 23 to 85 with 


TABLE 2 
DISTRIBUTION OF ACCIDENT FREQUENCIES FOR PATIENT 
SAMPLE AND RANDOM SAMPLE or 
CALIFORNIA DRIVERS 
рр ——===== 
| 
| California Patient Expected 
Accidents drivers | frequencies | patient 
percentages | | frequencies? 
None mé | 13 | M97 
1 17.49 | 31 | 28.85 
2 3.20 E 5.28 
3 0.53 | 0 S 
4 0.10 0 17 
5 0.01 0 02 
6 or more 0.01 0 ‘02 
Total 100^; 165 | 165,00 
Ло > > 05. 
8 Si frequencies may lead t i 
mptions un Heine ie jy 


of th 
the catego! 
well, 1964). 


idents or more were combined (Max- 
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modal patient is a 40-year-old married male, 
white schizophrenic, 

Table 2 presents the accident distributions 
for the patient sample and for a random 
sample of the California male driving popula- 
tion (Department of Motor Vehicles, State 
of California, 1965). The male Population 
(N = 86,717; mean age 40.3, median age 
38.8) was used as the most appropriate com- 
Parison group, since 94% (155 patients) of 
the patient sample was male. Eighty percent 
(133 patients) of the sample had no accidents 
in the 3 years Prior to admission. The mean 
accident rate for the patient sample is .20; 
the mean accident rate for male California 
driving sample is 
determining whether 


1964). Chi- 
Square analysis yielded a value of 4.75 which, 
degrees of freedom, is not significant 


Table 3 presents the distributions of viola- 
tions for the patient sample and for the Cali- 


TABLE 3 


DISTRIBUTION oF VIOLATION FREQUENCIES FOR 
PATIENT SAMPLE AND RANDOM SAMPLE 
OF CALIFORNIA DRIVERS 


California т Expect 

Violations drivers’ Patient dien т 
frequencies pa aod 

percentages frequenciess 
None 49.87 76 82.28 
1 24.44 39 40.33 
2 11.84 24 19.54 
3 5.94 9 9.80 
4 3.13 4 5.16 
5 1.82 5 3.00 
6 1.15 2 1.89 
7 -68 2 1.12 
8 .39 0 .64 
9 or more 74 4 1.12 
Total 100% 165 165.1 


Note.—x? = 5.15; .50 > р 2.30. 

a In this table the number of violations of five and above were 
combined in order not to violate the assumptions underlying 
the use of x?. 
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TABLE 4 E 
= үт COUN 
DISTRIBUTION OF N EGLIGENT-OPERATOR Dis 
FOR PATIENT SAMPLE AND RANDOM SAMP. 
OF CALIFORNIA MALE DRIVERS 


California Ей 
Teel; male Ехрес 
p] drivers? Patient patient 
wae ein | point count frequencies frequen 
(percent- 
ages) a | 
0 | 46.18 67 s 
1 24.58 38 218 
2 13.21 21 118 
3 7.16 13 6.2 
4 3.76 9 35 
5 2.14 5 22 
6 1.34 3 11 
7 0.69 4 07 
8 0.42 1 04 
9 0.22 1 05 
10 or more 0.30 3 
A 1650 
Total 100% 165 
d 
Note.—x? = 11.67; .05 > р > .02. do 


of 5 802 
Е i ants Оой 
s In this table the negligent-operator point His assumP 
above were combined in order not to violate 

underlying the use of xt 


on 
fornia male driving population. Almost d 
half (76 patients) had no violations ^", 
over two-thirds (115 patients) had m 
than one driving violation during the 15510” 
preceding psychiatric hospital айт 
The mean violation rate for the a fof 
sample is 1.34: the mean violation o: ch 
the male California driver is 1.10. THe Ce 
Square value of 5.15 with 5 degrees 0 
dom is not significant at the .05 level. t 
fore, it seems safe to conclude a dif 
respect to accidents and violations no I re 
ference is found between the obser", je 
quencies in the patient sample and fred ly 
to be expected were a sample drawn ra” mos 
from the California male driving pop" ined 
All recorded violations were next cerato! 
in order to determine the “negligent-oP mp 
Point count” for each patient in the for 
This is a designation used by the Ca! con 
Department of Motor Vehicles and Js 
Puted in the following manner: Each гес йё 
accident results in | point and each гес in ! 
conviction (driving violation) results agr 
point with the exception that a recorde А ов 
viction results in 2 points if it involve 


| 


М 


Driv ORD OF NEUROPSYCHIATRIC РАТІЕМ 
ING REC N TS 
О: н 99 


Of the six violat; 
tiving, уда (e.g., misdemeanor drunk 
esignated in t run, reckless driving, etc.) 
river who E California Vehicle Code. 
any Їй, tains at least 4 points during 
"-month peri We or 6 points during any 
month аны , or 8 points during any 36- 
Operator” т is defined as a “negligent 
Called in for hese drivers are subsequently 
E his thie EROR during which details 
ч. а decisio апі violations are examined 
Vocation n is reached with respect to 
Privilege, ©" Suspension of the driving 


b able 4 pr 
tie esligent-opera the frequency distribution 
s t sample rator point count for the pa- 
mle of the RE the male (№ = 86,726) 
Bree ес Lanes ifornia driving population. 
Qs 3 Of freedo e value of 11.67 with 5 de- 
йар е of nis is significant at beyond the 
More Уе cine Table 4 indicates 
10 2 ree of ^ have a point count of 8 or 
siden, More, Th hese have a point count of 
ed Negligent o. would definitely be con- 
at, Perfect operators and in the theo- 
Шр F Simm as each would be im- 
усте Of decidi ned to a hearing for the 
sation of th ng on possible suspension ог 
ate © es indica driving privilege. 
all th. Oved fr ates that when these five cases 
lation Se in hea the distribution along with 
of g with A M California driving рор\- 
pe, ore, créligent operator point count 
where ү Шз y is reduced to 
Prom the A. statistically not 515- 
ut diff ata there appears to be 
“сер and the rnd between the patient 
istrip At the hen male driver group; 
iei ot bi Y end of the point-count 
$ very small proportion of 


Co 
Nor, 
U 
SION AND DiscussIoN 


of , re 

„th Sults . 
Wate Patients this study indicate that most 
seran Wards ны to the neuropsy- 
riy, cmi f the Sepulveda (California) 
En Wer N Hospital with ac- 
"nq апд €nses in their possession have 
Ali ot to dan records which are 
ng 1а mal ег significantly from the 
te | Consist driving population. This 
hat wh ent with the studies that in- 
en Veterans Administration 


TABLE 5 


DISTRIBUTION OF NEGLIGENT-OPERATOR Point С 
FOR PATIENT SAMPLE AND RANDOM SAMPLE P d E 
FORNIA MALE DRIVERS WITH reser v T 
OPERATOR” Cases REMOVED Е 


California 
Negligent- male 
operator drivers’ Patient Expected 
point count point count | frequencies patient 
(percent- frequencies* 
ages) 
46.61 67 m 
2481 38 woe 
39.70 
13.33 21 
3 21.33 
7.23 13 E 
11.57 
3.80 9 6.08 
or more 417 12 6.67 
6.70; 30 >р > .20. 


t-operator point counts of 5 and 


table the negligen 
r not to violate the assumptions 


above were combined in ordei 
underlying the use of xê. 


ned to the community, they 
s of violence and fewer 
felonies than average males who have never 
been in a mental hospital. Some additional 
degree of support is indicated from а study 
by Davis and Coiley (1959). They conducted 
a psychological and medical study of a group 
of motor-vehicle drivers whose accident rec- 
ords suggested that they were accident prone 
and compared these with a group of drivers 


with records good enough to compete in safe- 
They state that the most 


their study is that all of 
in their sample (N — 126) who 
a definite nervous or mental 


patients are retur! 
commit fewer act 


accident-prone” group. 
The results also suggest that any further 


restriction of the mental patient’s driving 
rivilege will not, 
justified by his driving record. For various 
reasons many individuals with a history of 
mental illness do not drive. In many cases 
this is a result of the lack of assertiveness in 
the individual whose license has lapsed dur- 
ing his hospitalization. Undoubtedly, among 
these are individuals who could be rehabili- 
tated more effectively if they obtained and 
rcised their driving privilege. This could 
lished without adding to the al- 
ficant risks on the highway. 


ехе 
be ассотр 
ready signi 
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On the other hand, 3% of the sample 
studied had driver records which were serious 
enough to classify them as negligent oper- 
ators. These people warrant further study in 
order to more precisely identify the psy- 
chologically definable characteristics of the 
mental patient which тау be expected to 
Cause accidents. There is an apparent re- 
luctance on the part of the judiciary to ex- 
clude from licensure an individual who is ill 
or disabled, unless it is demonstrated and sup- 
ported by factual data that his impairment 
under the normal conditions of use affects his 
driving ability. Despite this, it is current 
hospital practice to presume that need for 
Psychiatric hospitalization is sufficient cause 
to restrict the driving privilege. With the 
of the night and day hos- 
the increasing practice of 
reducing the cultural discontinuities imposed 
by traditional hospitalization, there is a need 


to square the Practice of restricting 


j driving 
with the social 


and economic necessity to 
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drive. The most economical manner of ас 
complishing this would involve closer d 
tion between hospital authorities and é 
driver-improvement analysts in state ue 
vehicle agencies for the purpose of 6227 
identification and prompt selective ын. 
tion of the mental patients who are seriou 
highway risks. 
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This st 
S study wa x 
situstional e А conducted to determine the degree of interrater reliability i 
ests and to determine the relative effectiveness of e, A 
anı 


rnal of Applied Bs i 
1967, Үш, Ste No. 2 оку 
a Uo 
n i 
vir. nal evaluators in this 
diff reliability of observer ratings 
oe situational tests. 
um Qe reliability can be obtained f 
isiness-oriented situational tests. 
In 
today’ 
gr ay’s soci 
ind of А е composed of large 
i i s ү 
es of amen uals, a hierarchical struc- 
ernn ation is prevalent in business, 


nental E 
= selection pi aie ae organizations, etc. 
ries to positi individuals to move up the 
icularly in n of greater responsibility, 

b EOM 
usiness organizations, has 


ally res 
У relie : 
© man’s d on the recommendations 


adition 


Cearc} 
à studi : 
lies utilizing objective tests have 


conducte, 
ent, е by several organizations 
1961. g 1962; Mahoney, Jerdee, & 
recently Pitzer & McNamara, 1964). 
longi Undertake, few business organizations 
leg, fests in n programs utilizing situa- 
vice гау, ie to written objective 
tin, 19 ? si 2; Educational Testing Ser- 
y Situational tests have been suc- 


Ws: descri 
е bed (Flanagan, 1954) а5 fol- 


S 
аге sele 


Ше | 
© а о сс fo Ве typical of those In 


, 
Meli a age is to be pre- 
it is нано is made sufficiently 
now Whi М difficult for the persons 
9n What hd their reactions are being 
B evide variables. There seems to be 
Tubes (face validity) that the 
“ations еѕ spontaneously and naturallv 
© situation: It is hoped that the natural- 
ons result in more valid and 


роп, 
Ses 
Lp. дате are obtained from other 


sit 


han 
егег, 
Ore 

al à 
fi ng situational tests do not 
n ir specific “on-the-job” 
=н place the individual in а 
еру some basic manageria 


type of situation. 
and ranki 


Of particular significance 
rom the use of nonprofessional evaluators 
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The results indicate that 
ngs are reasonably high in several 
is the finding that 


characteristics will have to be displayed in 
order to carry out the situational task. There 
are two types of situational tests commonly 
used: group exercises—the, participants are 
placed in a situation 1n which the successful 
completion of the task necessitates interaction 
among the participants; and individual exer- 
cises—the participant completes the task in- 
dependently, as in the In-Basket (Lopez, 
1966; Educational Testing Service, 1964). 
In the group situational test each par- 
ticipant is usually evaluated by two or more 
observers. Accordingly, à practical problem 
encountered in the use of this technique is 
the degree of rater agreement. Without ap- 
propriate reliability of observer evaluations, 
the potential validity and usefulness of situa- 
tional tests in managerial selection or other 

similar situations 15 of course questionable. 
Although primarily focusing upon the test- 
and formulation of multiple methods in 
ality assessment, Taft (1959) discusses 
ncerned with the “background” 
ho have been used in various 
assessment programs. He reports that studies 
tend to indicate that the highest validations 
are achieved by those judges who have the 
greatest familiarity with the types of people 
who are being assessed. He goes on to imply 
ial, the best assessors 


that, all else being equ 
for predicting existing criteria are those who 
are partially contaminated with the experi- 


ences, standards, and outlooks of those who 
are evaluated in the assessment program. 
This would indicate that line managers 
es should be used as evaluators 
in managerial assessment programs. On the 
other hand, the problems involving judging 
biases are numerous in situational пас 


ing 
person 
some issues CO 
of assessors W 


or executiv 


| 
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ment programs. Perhaps assessors who have 
professional training in assessment could 
better objectify the participants perform- 
ance and obtain greater interrater reliability 
than so-called попргоѓеѕѕіопа] managerial 
officials. 

The present study, which is part of a 
larger project pertaining to managerial selec- 
tion, analyzed the degree of interrater reli- 
ability of situational tests and Presents some 
results pertaining to the use of professional 
and nonprofessional assessors. 


PROCEDURE 


As part of a 2-day personnel assessment program, 
individuals were assessed by situational (group and 
individual) tests and by traditional Paper-and-pencil 
tests. In each 2-day Program, 12 participants were 
evaluated by a team of 4 observers. In each situa- 
tional test, however, 6 of the Participants were evalu- 
ated by only 3 observers, Thus, in one exercise, 
the 6 participants would be evaluated by Observers 

3 in another exercise by A, B, and C; 


of an exercise each observer indep 
ranked each Participant in the group. 


Variables 


Observer ratings and rankings, First, each observer 
rated the 6 individuals on а 5-point scale: (1) much 
more effective than most in th 


d © group, (2) somewh t 
more effective, (3) about as effective een h 
group, 


al communications 
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from 1 (best) to 6 (poorest) on their overall 
effectiveness in the group. И dif- 

Group situational exercises. In this study meer 
ferent types of group exercises were used. E 
three situational tests were all related in some man 
to the functioning of a business concern, athog 
in each exercise there were distinct managerial EL f 
ities and various arcas of knowledge being ME 

l. Leaderless Group Discussion: Each partorg 
was required to make a 5-minute oral presentation е 
a candidate for promotion, and then subsea i 
cach participant defended his candidate in a p 
discussion with the other participants. The i 
given the participants were well defined and struct iyen 

2. Task-Force Committee: Participants were E s 
data from which they were to form a group TeC on 
mendation to the president of "X" company, v, 
Which of three alternate courses of action to This 
for expansion of the company’s activities. Jess 
exercise was similar to the leaderless except for 
structured roles, 

3. Manufacturing: The participants wer ü 
to work together as а group and operate à үө 
facturing company in an effective manner. They he 
required to purchase materials, manufactur qq 
Product, and sell it back to the market. Жр of 
in this exercise was a product forecast, fluctuat! ucts 
prices for raw materials, and completed Be ants: 
etc. There were no assigned roles for the partic eat 
and both verbal and physical activity were prev“ 
in this exercise, 1 di- 

Subjects. During the past 2 years, SENE er 
visions of a large electronics company have mat 
taken a Personnel assessment program. For pave 
tical those divisions which jr 
evaluated at least 36 individuals are reporte е con” 
divisions (A, B, C, D) of the company hav 
six different programs. For 


e required 


Division де 


„у. there were three different assessment programs - jj. 
ran A the 
anked the 6 Broup members rated by a considerable period of time, and; 
TABLE 1 
RELIABILITY COEFFICIENTS ОЕ OBSERVER RATINGS AND RANKINGS 
- Task Force Leaderless Manufacturing 
Division 
Rati { à ings 
Mears Rankings Ratings Rankings Ratings Rankin’) 
Mean r (2) | Means (Z) | Mer (Z) | Mean ғ (Z) | Mean 
A (N = 144) 
I(N = 4g) 75 
E 81 .84 
II (V = 48) 62 70 0 pa es 77 
III (N = 48) .86 82 p p 77 ‘30 
та = E Л4 75 p p^ 7 83 
ү = m :65 .65 66 68 74 81 
D (N = 36) 84 78 48 48 49 49 
` m 
a Pearson product-moment correlations were used 1 gopal 
(in each experimental group three observers independently үш ИЛ the degree of Tater agreement for an experimento tog 
sonnel rou is PPh mun de УЕП ae a ter tenent for a partieular se 10 
expe: en Blan up л р г ш division were then averaged (after con ON Program, the interrater reliabilities о! пке] 
the participants and Kendala cocti ae Shey no determine reliability of ranking 00 ue М ааа шо. observers rent? 
pone oncordance was used to obtain th £ except that in each group th il 
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TABLE 2 


MEANS AND STANDARD DEVIATIONS OF 
OBSERVER RATINGS 


Division N i p 
мк Force 

A 

B 144 sss jon 

c 48 2.742 1.054 

D 60 2.777 986 

Tot 36 2.964 1.009 
M ч 288 2.950 1.020 
Y Tanufactuting 

B LH 3.039 1.088 

c 48 2.873 1.077 

D 60 3.047 o7 
Тош 36 2.883 .896 
L 288 3.007 1.066 
"еле 

B 144 2.864 .958 

С 48 2.658 “883 

D 60 2.855 1.090 
Тош 36 2.686 n 
те ы | 2.799 2.966 
fore Е 
бо ТОШ 

Tom { ШАҢ numerals I, II, and III indicate results 
(АТ е thre 
tam, АЦ, Аш, Programs, In five of these programs 
ы tom the B, and C), the individuals assessed 


m 
b "S xis Same functional area and were from 
We Visiona] le-management-level positions. In the 
Pany om Program, the individuals being assessed 
› апд уу ОЧУ functional areas of the com 
By, ana cre generally from middle- to upper- 
Jug], "Ferial Positions. 
Y ucl individuals who served as evalu- 
(hi hologi,, Sied into two groups: professional 


1 H . 
mid eve] ex 9r sociologists) or nonprofessional 
(5 but with only 


The 


Programs A, B, and C were at least 


l levels above the participants, but 
Mas nonprofessional evaluators Were 
above the participants in manageria 


RESULTS 


are presented the mean reli- 


es 
~ of 
rankings 


пар 18 бры ratings and s 
ump „ercis ivisional program and situa- 
ber of .*- In this table, № refers to the 
Ac ptici Þarticipants. As indicated айй 


ап С 
ты 18 Were evaluated in groups ° 
ёе o 


bs cor- 
Visi, êting ervers, Thus the mean 


of .75 for the Task Force for 
18 based on 24 correlations: 

Sets of observers. These results 
е reliability of observer ratings 
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and rankings are reasonably high in most 
cases; the exception to this general statement 
are the reliabilities for Division D for Leader- 
less and Manufacturing exercises. The rank- 
order coefficients may be somewhat spuriously 
higher than Pearson r coefficients (due to 
algebraic differences). 

A comparison of observer-rating and ob- 
server-ranking reliabilities indicates that these 
two methods are approximately equivalent 
regardless of situational exercise or divisional 
program. 

In Table 2 are presented the means and 
standard deviations of the observer ratings 
of participants according to divisional pro- 
gram and group situational exercise. As in- 
dicated above, these ratings were based on a 
5-point scale, 1-5. F tests were undertaken 
(Table 3) to test whether there were sig- 
nificant variances of observer-rating distribu- 
tions among the divisional programs. For 
all three situational exercises the results were 
not significant. Therefore, the distribution of 
ratings. among the divisions was generally 
consistent with one another. 

Due to the limited amount of research 
data available in this area, it is difficult to 
evaluate the adequacy of these observer 
reliabilities to what might be obtained in 
other similar programs. Some data are avail- 
able, however, from an AT&T study (Grant, 


TABLE 3 
ANALYSIS OF VARIANCE AMONG DIVISIONAL 
PROGRAMS 
Division SS df MS 
Task Force* 
Between 6.62 3 221 
within 288.61 284 102 
Total 295.23 287 
Manufacturing? 
Between 1.13 $ 38 
Within 314.5 284 111 
Total 315.63 287 
Leaderless? 7 
Between „3.57 3 119 
within 279.1 284 98 
Total 282.77 287 


104 JoHN M. Ске 


TABLE 4 


CoMPARISON OF OBSERVER RELIAn 
SIMILAR PROGRAMS 


ILITY IN Two 


ТЕ Present study 
Division (N = 288) 
Task Force 
Overall rating E 
Overall ranking | 71 
Leaderless | " 
Overall rating .66 15 
Overall ranking .64 75 
Manufacturing 
Overall rating 74 .60 
Overall ranking 45 .69 


1964), and a comparison of obs 


ment is presented in Table 4, 


made to Compare these two 


populations as to Whether they 
lent interrater agreement (W 
1953, p. 255). The analysis 
the AT&T reliabilities were 


higher (р < :05) for the Leaderl 


the interrater agreement is of 
Warrant the continued use o 
Situational testing, 


Comparison OF RATING RELI 


erver agree- 
Analysis was 
independent 


have equiva- 
alker & Lev, 
indicates that 


significantly 
ess exercise, 


the Manu- 
in both studies 
а magnitude to 
f this type of 


TABL 
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ercises. The one exception to this gener 
statement is Division D. d 
After an initial examination of e 
server reliabilities, it was conjectured D 
in those situational exercises for D 
where low reliability of observer esca 
peared, it might be partially due to vig ob 
tion in the professional experience of E p 
Servers. The basic rationale of this d 
thesis was that the use of both prons 
and nonprofessional evaluators ане © 
ous) in the same situational рТ, 
ercise might consistently lower the wer 
of observer agreement compared to а 5 
of homogeneous evaluators. 60 ir 
From an examination of the data, уай!” 
dividuals were identified who had been yet Я 
ated by two professional and two no jn 
fessional evaluators. Since 12 puts 
Were evaluated by the same 4 evalu an 
the ratings of these groups of 12 ШИШ Д 
аге presented individually in Tables 5 ts 0 
In Table 5, each case (V) represen eas 
evaluators rating a participant. The ё "a 
for the inequalities of cases within : ral 
ercise or among groups was due to Qe x 
arrangements, For example, in one gro! rà 
ercise, 6 participants might have been jon! 
by 2 nonprofessionals and 1 gm. of 
evaluator, resulting in 12 сотрагіѕ0 on 
Donprofessiona] with professional and rof 
parisons of nonprofessional with nonP 
sional. orre” 
In Table 5, the product-moment “roe 
tions between nonprofessional and non} 


E 5 


/ERS 
ABILITIES FOR PROFESSIONAL VERSU NonproressionaL OusERVER" 7 
Task Force acturing d 
Group ЭН Manufac ee Ў 
Зерен T — d 
NP vs NP (M » J Р 
e YENP) Рев | Bys PysP [NPes NP| P vs NP 1$, 
1(N = „21 .80 91 0 pe 
W-9 | way aaa aw Pa | O ig 
am 
Ds (N = 12) ES 57 68 3 per 
(N=6) |у 24) | (Wee 6) (N 8 2) | O 
Di (N = 12) „89 во j 75 
(N= 24) | (W'S 12) (N= 12) | wy Con aman 58) 
R i 6 
В (№ = 12) Во _.79 58 йй кй г 
(N 26) | (у 24) | (М“= 6) | qy = б) tV S agi aE 24) | O 
С(Мо=12) 63 75 97 T T zi 
^ I А E £ 1 К Р 
Total V =60 (У = 6) | 9920 | W =6) | 2 12) | (w= 24) (м = 12) | v 24) " 
Oan RAE M Ai fi ы 
Note.—Abbreviations: NP = nonprofessional; Р 
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TABLE 6 
PRoFEssionar, VERSUS NONPRO 
OBSERVER RATINGS 


Division 


N | ar |8р| N 
| 


18 | 3.06 | 1.05 
0.04 18 


18 1.00 18 
18 130| 18 | .36 
18 128 | 18 | 1.28 
18 18 | .57 
18 18 | .76 
18 18 |2.33* 
18 22 aes 


"m 
i a 
al LAUDES, 


sio ratings professional and nonprofes- 
te па] tatines and professional and profes- 
бу, Wo-tail - presented. Appropriate £ 
dite eterming ee were computed (T ‘able 
typ etes wi hether there were significant 
Dares? Pes of een the mean ratings of the 
"ticipants Observers for the same group of 
ls th Оте aker & Lev, 1953, p. 151). 
a Айту уез the interrater reliability 
ou, ates in a кү (Table 5), but when one 
eli pup (pr еп situation the heterogene- 
fes щш т essional and nonprofessional) 
ang Pal ang the homogeneous group (pro- 
“ар Monprofer rofessional, or nonprofessional 
пор ear Slonal) reliabilities, they 8°? 
teat Cous gro equivalent. Also, neither ho- 
Om & in ten UP consistently appears to have 
тү Аду E reliability than the other 
ND results Pi heterogeneous groups. 
des evalu, n Table 6 indicate that neither 
€t rating of consistently gave higher 
nu bd ч the participants (in Table 
in etia, ratings indicate high par 
Scores 1685), and the distribution ^ 
ofa es 15 about equivalent for both 
Sors. These results suggest that 
Sig. ON, ang icant differences between 
ш instap. PONprofessional raters, ex- 
nce where the results did reach 
ure chance probability). 
explanation for the lower ob- 
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server agreement in the Division D program 
is (perhaps) due to two distinctive features of 
this program in comparison to the other 
programs: first, the participants assessed 
were from various functional areas; and sec- 
ond, the nonprofessional observers were prac- 
tically at the same managerial level as the 
participants. The data obtained in this study 
cannot adequately dilineate which one or 
combination of factors might have some 
bearing upon lower rater agreement in the 


Divisional D program. 
DISCUSSION 


From the above results, one should not 
assume that nonprofessional personnel, who 
are without substantial business experience or 
lack any training in evaluating participants, 
should be employed in assessing personnel. 
Furthermore, as in this study, the instructions 
to the evaluators, whether professional or 
nonprofessional, should be explicit as to the 
specific type of behavior to be evaluated, 
examples provided as to kinds of behavior 
that may be expected to be elicited by the 
specific situational exercises, and standardized 
rating forms provided for their use. However, 
the results tend to indicate that the selection 
of evaluators for this type of assessment need 
not be based on whether they have completed 
an extensive training program Or have pro- 
fessional experience in personnel assessment. 
Perhaps an exception to this rule would be 
the evaluation of top echelon executives in 
a company where only independent pro- 
fessional evaluators could objectively evaluate 

icipants. 
opens of this study suggest that 
reasonable rater reliability can be obtained 
in situational tests commonly used to assess 
business and industrial personnel regarding 
their potential for advancement. These re- 
in no way indicate the 


rse, 
sults, of course, ; | t 
validity of situational tests 1n predicting 
managerial potential or success. 


The results further suggest that both ob- 
server ratings OT rankings of participants in 
situational tests generally have adequate reli- 
ability as methods for evaluating perform- 
ance in situational exercises. | 

The comparison between professional and 
nonprofessional evaluators indicated that their 
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s ` in the & 
i J z siderations in 

i i r a specific Franacan, J. C. Some con "E 
I. M coh эб. There. velopment of de som tests. Person | 
Бнр 107 partic 5 ч chology, 1954, 7, 461-464. | "T 
fore, an expectation that ratings by non- Grant, D. L. Situational tests in the "€ ie 
professional assessors in Such exercises would managers. Part II: Contributions to Em 
ment process. The Executive Study 


i 7 nd developm^" 
ferences in experience, training, and aware- A hs uq on “Мә poo Servi 
ness of common judging biases—seems un- 1964. Pp 196144" ue 
Warranted. In general, it can be concluded Laurent, Н. А summary of early pe М 
that either type of evaluator can be used management potential. Research Б оте { 
interchangeably as observers, There might Science Research pem e mn 1961. (0 
still be judging biases associated with ratings lations Department, Standarc 


| 

published report) , апаў” 

s .Dut both types of evalu- Laurent, Н. The early identification of iid! 
ators should give either equally valid or in. ment talent. The Conference on Execu 


i п 
Identifying management talent. Princeton, | 
d be undertaken to show Educational Testing Service, 1962. nt 
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EFFECTS OF CHOICE AND SALES MESSAGE ON 
CUSTOMER-SALESMAN INTERACTION 


JOHN U. FARLEY лхр ROBERT І. SWINTH 1 


Graduate School of Industrial Administration, Carnegie Institute of Technology 


А group of 87 female Ss were presented alternative sales messages for a roll-up 
та 1 presentation stressed product attributes and the other stressed a 
En] plimentary personal discussion of how the product is consistent with S's 

e in life. Each S provided scaled evaluations of the product and the sales- 
Anc dr making her choice between the product and a sum of money. 
` Enificant and positive differential evaluation ot both product and salesman 
Vere found for Ss who chose the product rather than money and those who 


receive i i 
eceived the presentation stressing 


ev; i В : : 
aluation-presentation interactions were a 


product attributes. Evaluation-response and 


lso significant, although sales rates 


Were approximately equal for the 2 sales messages. 


, Despi 
tons "rms e annual expenditure of bil- 
іса] st а on salesmen and sales effort, 
1 the sa E У of the personal interaction 
hea salesman’s stock 
"A “inter atively new. Homans’ (1958) 
[22е of а between persons is an 
the 597)» ap S, material and non-material 
ай, eee consistent with much of 
OUSA the latt sales-management literature, 
* Exper} er is often not explicit on the 
° is ¢ eed show that social ex- 
t ips (B eristic of most interpersonal 
like Stance ack, 1950; Gerard, 1954). 
they, to com ee of a group are more 
fee] БШ 4 with each others’ wishes if 
hop field gt) the others than if they do 
«d that E. tudy of insurance salesmen 
ieee, of various perceived 
“teased th attributes of salesman and 
{ tun? result qr. likelihood of sale (Evans, 
eri Which directly analogous to similar 
in, Urt] ha field 
оа her, the 
lig, “tion of , motional state resulting from 
(Чың of im WO people can include evalua- 
Фаг, jo, P*rsOna] objects and events 
sito, lance the апа this has been generalized 
, dn for а Which predicts equilibrium 
атр ch evaluation-evaluator pairs- 


wt е, i 
s two people share an affec- 


make for successful 


Org А 
Кү € indebted to Victor Vroom for 
ерен оп the study. | 
dealt wi ber 1956 issue of The American 
ban interview-respondent inter- 

T of levels and is germaine to 


tion for one another, in equilibrium they will 
share a feeling (positive or negative) toward 
an object (Cartwright & Harary, 1956). Ap- 
plied to the sales situation, this theory 
implies that a customer who purchases should 
show more positive feeling toward both sales- 
man and product than a customer who does 
not purchase, presuming the salesman shows 
a favorable feeling toward the product. If 
the balance-theory formulation is correct, 
analysis of the sales situation requires study 
of attitude toward the salesman as well as the 
product, especially in view of the common 
notion that salesmen are by and large evalu- 
ated negatively (Levitt, 1965, p. 31). 

In this vein, one might think of the sales- 
man as engaged in two activities that con- 
tribute to customer action. The first is pro- 
viding data about the product so that the 
customer is able to make an informed choice; 
the second is providing a degree of personal 
interaction and recognition. In the latter 
aspect of his work, the salesman often as- 
sumes an inferior social role relative to the 
customer (Leavitt, 1958). Since self-esteem 
is an important aspect of human needs, it 
follows that a basis for exchange may just as 
well be filling needs for esteem as needs for 
data. In Homans’ (1961) terms, the inter- 
action may “apply, for instance, to the ex- 
change of intangible services for social esteem 
in a market that is far from perfect [p. 12].” 
While studies of personal reactions of sales- 
е to customers are available (Lombard, 


еор1 
р 1948), much less has been 


1955; Whyte, 
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TABLE 1 


ANALYSIS OF COVARIANCE OF SCALED RESPONSES TO 
QUESTIONS AnouT THE SALES SITUATION 


| aj | us | Е 


Effects 
| 2 

Regression on covariate | t] 12.6681* 
Main effects n 

Questions (Q) 9 pl 

Choice (C) 1 23.6348 

Pitch (P) 1 67.9098 | 24.0809* 
Interactions | "MT 

QXxXC | 9 | 10.1087 | 3.7185* 

ОХР 9 8.1919 | 3.0145* 

РС | 1 | 1.6635 | 0.6119 

PXQXC | | 1.7703 | 0.6512 
Adjusted error | 745 2.7185 

*p <.01. 


done in terms of prospects! reactions to 
salesmen. 

This study explores two questions: (a) 
are the implications of the balance the 
borne out in the customer-salesman inter- 
action, and (b) which is more valuable to 
the customer—information about the product, 
or personal recognition that builds his self- 
esteem? Previous research indicates only that 
liking both salesman and product is im- 
portant, but not whether the appeal to 
or the other link of exchange 
more effective, 


огу 


опе 
is likely to be 


METHOD 
Subjects 


There were 32 undergraduate female students 
interviewed individually in a special school room, 
plus 34 student wives and 21 s 


I ; uburban housewives 
interviewed at home—in all, a sample of 87 
respondents, 
Procedure 


5 market value 
ed correctly and that no 
pretest S owned a close substitute. The money 

; the median estimated value from 
the pretest. 

Two presentations Were used i 
vary the social exchange between salesman and 
customer—one which emphasized а description and 
demonstration of various features of the Product, 
and another which stressed why S's manifest role 
(student, wife) is important and why the Product 


n an attempt to 
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wet 
ssages 
is consistent with that role. These messag n" 


weh? an 
dubbed, respectively, the "product oo identi 
“personal pitch.” The product pitch ше 

for all Ss. The personal pitch was osed Sf 
identical although the appeals were ККА { 
cially for each of the three groups S ENIM 
received one message, and the ient or 
given randomized tables giving the exp be g 

in which the two sales pitches were ad ol 
Subsequent to choosing between the зен 

each S filled in a questionnaire e А л 
aspects of her perception of the value А 
stick, her response to the salesman, an 

ment of the interviewing situation. 


wit 


REsuLTS AND DISCUSSION 


iw 
: 465 W 
а А = ovide 

Analysis of the questionnaire pri Jes? 


plications for both the equilibrium à уб. 
buyer relationship and the зна И 
product evaluation process. The nals, 
sponses to the 10 questions were сохай", 
in an analysis of covariance. The le s 
was a three-valued discrete manise gi" 
for an intergroup effect for the per pot” 
of Ss—students, student wives, a! eg 
wives. The large F value for the r efit 
(Table 1) shows that there is sieh f we 
The data, adjusted for the ru d 
analyzed in a factorial framework; Уру gè 
main effects: а question differentia met 
cisions at the conclusion of the pat бї! 
that is, whether they chose the mo pitch 
product; and the particular sales s dn gl 
Which they were exposed. The facto as yd d 
permits analysis of the interactions equ al 
the main effects. A routine using UP quest yi 
sizes was employed because a few on Pub 
were missing or not responded p y 
interviews (although the questions +? pd 
never varied over questionnaire? y. 
Cause, of course, it was not poss! 


ing the сі, 
trol the proportion of Ss choosing бү 


jone б 
or the product after the presentat? atti 
the salesman showed a favorab Py 
toward the product and attempte é 
a friendly attitude toward the © ol 


си? pi 
5 hi e Я 
these links are given and only th Jin? | 
product and customer-salesman N af, 
under examination. 


ysl? r 
The results of the factorial апай ec ү, 
Shown in Table 1. Each of the uf 
highly Significant, indicating iMP jon? d 
Sponse differentials among the que enc 
analysis normalizes out these differ 


И 


JN 
ist, 
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TABLE 2 
MEAN SCALE VALUES FOR QUESTIONS WITHIN GnovPs RECEIVING THE SAME 


SALES MESSAGE AND MAKING THE Same CHOICE 
| Sales message received Respondent choice 
Question 
Product Personal Took Took 
pitch pitch product ook money 
lp = — > А 
А е pri | 

psu: I would expect to pay for this | m 
2 Thede 1.8. retail store. 5.57 | 5.67 5.65 548 
3, н of this product to me. 7.29 | 6.44 7.03 6.34 
X The пез of this product to me. | 15 | 6n 7.62 6.34 
~ With кока of this product in comparison | | _ | " . 
> The nile c Similar in price and function. 7.13 6.67 7.07 6.33 

Tather | of this product rather high or | " EE 
6 De n | 466 4.98 4.83 4.77 
„пре sman was rather pleasant or rather | » "Hen 
fi The oe | 8.20 7.60 7.93 7.77 

Salesman’s “pi = Р 

Ог rg nan’s “pitch” was гаће TA : 
3. 7 ae Interesting s iig paler: boning | 4.33 4.55 4.30 4.93 

€ points the B. | әд 
9. Muentia] the salesman made were rather | _ ds 6.0 412 
"he salesman unintluentialin my decision. | 6.47 4.73 А 

SOCSün was ra RT 
10, т ец, was rather efficient or rather | 2588 689 742 107 
ather eni | 14 E 

Dating ;  JOved or rather disliked xartici- | 66 

~ Rin this study, Ба | 8.23 7.68 8.06 in 


= 
Scale directions — 
ШО 
n the tea ot values, More meaning- 
5S5! choi hat each of the other таш 
signifie Ces and the message received 
Че опе, ant effect on the responses to 
ау Жо, of the interactions аге 
N effec s nificant over and above the 
Mia interactive effect of the type 
асру €d on question responses and 
А е effects of choice (money OT 
ie cd ana oe The other pair-wise 
8hificant he three-way interactions are 
i aia pooling for degrees of 
The Ате ‘tee y because the other 
А analy si. "d highly significant. 
ans fects covariance establishes that 
Rust he are present, but within-cell 
cts examined to study the nature 
А he n mean scale values of 55' 
(a, iere, Gate ons for the two main 
val tu en message received anc 
ues are { are shown in Table 2. 
t each or an 11-point scale from 
nun Of the questionnaire items. 
Means a more positive r€- 
ole the two scales (5 and 7) 
S Were reversed as a control 


al 
Maj 


check to see whether respondents were read- 
ing the questionnaire carefully. In these cases, 
large values imply (5)a higher price and (7) 


a more bo 
The results ar 
theory, 


The first five items 


in the questionnaire measure aspects of the 


respondent's liking for the product—the ex- 
pected price, desirability, usefulness, quality, 
and relative price of the product to her. On 
these five scales, those who received the 
product pitch and those who took the product, 
їп all but one Case, felt more positively 
toward the product than those who received 
the personal pitch and those who took the 
money. The last five items measure liking for 
the salesman. The respondent indicates how 
pleasant, interesting, influential, and efficient 
the salesman was and how much she enjoyed 
participating in the study. On these latter 
s, those who received the product 


five scale: 
pitch and those who took the product felt 


more positively toward the salesman, again 
with but one exception. These results are 
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TABLE 3 
CHOICE RESPONSES TO SALES MESSAGES 


| Subjects’ choices 
Sales message 


ive SS] Total 
ге 
ББ: Product | Money 
Product 34 11 45 
Personal 34 8 42 
"Total 68 19 87 


corroborated in a further breakdown of S 
response by sales pitch. Among Ss who re- 
ceived the product pitch, those who took the 
product indicated more liking for the product 
and the salesman than those who took the 
money. Similarly, among Ss who received the 
personal pitch, those who took the product 
indicated more liking for the product and 
the salesman than did those who took the 
money. 

The results sh 
tion for product 


g interactions (Table 
that the successful sales appeal 


significant nonadditive components 
sonal commitment by the buye 
man as well 


2) imply 
includes 


as to the value о 
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The well-balanced sales message thus К 
pay significant attention to both materia E 
nonmaterial aspects of the sales interac 
The information exchange data e 
attitudes might also imply that the prot! 


ë В 3 indu: 
pitch is more effective in terms of : a 


customer choice. However, lcm E 
message chose the product (Table 75.14 
approximately the same frequency—^"; 


% 

ior the product pitch and -—— j 
the case of the personal pitch. These e i 
high sales rates are due primarily A atl 
appeal of the product, but are n ру! 
nificantly different from one another i 
chi-square contingency table test. Thus, o! 
balance hypotheses are consistent Wi 
Choice and attitude analyses, the Eo. 

hypotheses are not so consistently к | 
This is not, of course, the first 0 & d 
attitudinal data alone have been inst — 
to predict consumer choice. | 


REFERENCES m. 

Back, К. W. The exertion. of ngu m 
Social communication. In L. Festi тү 
Back, S. Schachter, Н. Н. Kelly, & Рур} 
eit i” 


jn 50010. 
(Eds.), Theory and experiment in Н Mid" 
munication. Ann Arbor: University 0 ra 
1950. Pp, 21.36. у 


bi 
Cartwricnr, D, & Harary, F. Бигеш y yo 
А generalization of Heider's theory- ii 
eview, 1956, 5, 277-292. jons, uf 
Evans, F, p. ‘Selling as a dyadic ree sae 
new approach. American Behavior б 
1963, 6, 76—79. nions P jf 
Grnamp, Н. B. The anchorage of opin 4, 
to-face groups. Human Relations, 1 | 
325. s organ 
Hemer, F. Attitudes and cognitivo os ss] 
Journal of Psychology, 1946, 1, 107- 5 ext $ 

Homans, С. Human behavior 95 63, 


{ 
E 58, / 
American Journal of Sociology, 19% | 
606. «т 

| 

| 


Homans, С. С. Social behavior: 115 


D 
forms. New York: Harcourt, Brace go! 
1961 Time, 4 

Leavitt, H, J. Sales management: 43 


Change? Dun’s Review, April 1958, rior B H 
Levitt, T. Industrial purchasing beha FA 
Harvard University Press, 1965. nins ^ | 
Lomparn, G, F, F. Behavior in a 1055. at! | 
Boston: Harvard University Press, 1 * rest 
Wavre, W, F. Human relations in e 48- | 
industry. New York: McGraw-Hill, | 


(Received March 30, 1966) 


| 
b 


Journal of 
"m 
967, Vol. КИЛТ 


CLINICAL, PSYCHOMET 


RIC, AND WORK-SAMPLE 


APPROACHES IN THE PREDICTION OF SUCCESS 
IN PEACE CORPS TRAINING 


LEONARD 


V. GORDON * 


De А 
partment of Educational Psychology, State University of New York at Albany 


A st i 
tun E to determine whether failure to be selected for overseas assignment 
e predicted prior to Peace Corps training. 178 Peace Corps volunteers, 
> 


assi 
ue to 3 programs, reported prior 
ch included individual situational 


Projective tests, and work-sample lang 


w ini 
ere made by clinical methods, from 


tio: 
е paper-and-pencil personality test s! 
ese last 2 sets of scores. All 4 sets 0 


Howev dew 
wever, no significant differences ос! 


ch Я 
еарезї approach being as effective as the most 


Clini 
1са] 
ceq assessment and psychometric pro- 


Ures ar 

ы follows: contrasted by Cronbach (1960) 
The 
sions 
diy 


Psychometr; 

of ability tradition isolates separate dimen- 
idua] Ў "апа personality and represents the 
tp, 578]. ee scores on these dimensions 
ce ee features of assessment 
бп ч а variety of techniques; 
йл servations in unstructured 
ologists ion of information by ex- 
Ores in Pos rather than combining 

а statistical formula [p. 582]. 


er di 
ads ni um associated with the two 
qoe ed teri the 
and wee the amount of data 
TR È typical, ized. Clinical assessment 
testin ly employ individual rather 
mare methods, tend to require 
are time for data gathering, 
Psycho Concerned with more data 
е metric methods. 
Bathered 17 amount and complexity 
valo evi E the asséssment approach, 
alid рр, «ence to suggest that it is 


ас а 
xs Меру the psychometric approach. 
h (1954) review of 20 studies, 
or Was 
Or S 


аге; 
Teliance 


е 


а 


" temporarily associated with 
om December 1964 through 
es кы of the present study- 
any © acknowledge the fine CO- 

Deople both within the Peace 
Particular appreciation js ex- 
Krug and Allen Kulakow of 
к J. Bartlett of the University 
р two language coordinators, 
аш У, Cooper. 


Crate 
ti 
US оп 
ША а 
tha ed 


агуу, Со А 
° Папа PS Саца, 


Abpo, nd 


to training for a full week of assessment, 
tests, paper-and-pencil personality tests, 
uage training. Predictions of nonselection 
language scores alone, from a combina- 
cores alone, and by assessment based 
f predictions had significant validity. 
curred among methods, the simplest and 

complex and costly. 

in which predictions by clinical methods were 
compared with those made by the psycho- 
metric approach, found the latter to be far 
superior. In a later review of the validity 
of global predictions, Cronbach (1960) con- 
cluded that the most ambitious efforts at 
assessment by psychologists give a generally 
“black picture.” Vernon (1964) in reaching 


similar conclusions, states 


be little proof that, by adopting 
s of personality, jt becomes pos- 
eatly on our naive method of 
bout people... - Indeed, clin- 
to be most effective when the 
approach more closely those of 
ned psychologist . . - [p. 89]. 


There seems to 
depth conception: 
sible to improve gr 
making predictions à 
ical diagnosis seems 
clinician’s methods 


the statistically tral 


Milholland (1964) in 
sessment area provide 
would challenge Cronbach’s or 
conclusions. 

The disappointing 


his review of the as- 
d no new data that 
Vernon’s 


results obtained by 
clinical assessment programs may be due, in 
part, to their being theory oriented rather 
than criterion (or problem) oriented. Cron- 
bach (1960) noted that the few successful 
assessment procedures tended to be perform- 
ance tests which were essentially “work 
samples” of the criterion task. 

The large amount of data that is typically 
obtained for each subject (S) in these pro- 
grams also may have contributed to the poor 
results shown by clinical assessment. Even 
assessor had collected criterion- 


where the 
tion, the utility of this in- 


oriented in forma 
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formation may have been reduced by the ad- 
dition of information in which he tended to 
place an undue amount of faith. Vernon 
(1964) also made the point that 


the clinician collects such complex evidence that 
his weizhing or Synthesis of it is liable to go awry. 
Having little information on just which predictors 
are most significant he тау put more trust in the 
poorer than in the better ones [p. 86]. 


Bartlett and Green (1966) have demonstrated 
empirically that beyond a few variables the 
validity of clinical prediction tends to be 
lowered by the availability of additional data. 

Although the weight of evidence, so far 
available, has not Supported the use of clinical 
assessment for selection Programs, and despite 
its very high cost, such programs continue to 
be developed. Undoubtedly, the face validity 
of the problems used and the confidence 


to the support of Such programs, 

Even where Clinical assessment has demon- 
Strated some validity, this alone does not 
justify the application of this approach in the 
operational setting. It is important to ask 
the question, “Will other, simpler tech- 
niques work as well?” Any study which 


employs expensive and elaborate testing pro- 
cedures should 


routinely incorporate and 
evaluate simpler procedures in order to pro- 
vide a fair and more c 


such 


based on Work-sample m 
other on Psychometric 
lengthy cl 
compared with 4 “brief 
only on informatio 
and the Psychomet 


Under current Peace Corps selection pro- 
cedures, an applicant submits to the Peace 
Corps a form on which he Provides informa- 
tion such as college grades, work experience, 
foreign language ability, special skills, etc. 
At a testing center, he is administered grou 
tests of mental ability, language aptitude, and 
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language achievement (if appropriate). | 
Peace Corps headquarters an арр aie 
garding his suitability for overseas ы. 
is derived from these materials and fiom al 
12 letters of reference. This шша 
conjunction with the applicant's Lanes 
and the availability of a suitable pn 
used to determine whether to accept 
Peace Corps training. 

The Peace Corps training 4 е 
resents а primary screening meii Ж“ by 
the volunteer is seen for the first im ji 
Peace Corps personnel. On the bass ете 
performance and other information БЕ si 
during training, a Selection Board, ү, p p 
of training personnel, a psychologist, 4 | 
chiatrist, and a Peace Corps Кармоо of 
recommends that he be assigned over р) 
that he be “selected out” of the Peace men 
While the factors on which the recom! art 
tions are made vary from Board т, ail 
special skills, performance in languag atin’? 
ing, psychological evaluation, and Per poat 
are typically given some weight by al "m 

On the average, about 25% of the end € 
аге selected out or drop out by агт пат 
training. This constitutes a considerab s. fof 
ship, Psychologically and economico. M 
Most of these volunteers, Some have a s, 
their jobs, sold their automobiles e үй, 
Dossessions, and said good-bye to thel" од Р 
and family for what was to BaN Ыр й 
2-year overseas assignment. In addi and f 
attrition is costly to the Peace Corps: © г 
quently prevents the filling of quotas 
portant programs. assi” i 

For both economic and б. иду y 
reasons, the Peace Corps undertook “atrai 
determine whether, by means of DI^" qut 
assessment, valid’ predictions could 
as to whether an applicant woul Ж 
fully complete Peace Corps trainin’, 
results were sufficiently promising: 
intended that а pretraining gue у 
Bram would be established operatio! 
use with al] applicants. Iv, "40 

For purposes of the present p end gi 
selected for overseas assignment at к WP, l 
training was the criterion of interes ней à 


n cH ue 
performance overseas is the ultimate © sc. 


sate CO soi 
à te ( 
it was not the problem of immedia -i | 
Since the deselection rate overseas 


np 
program |. 


al 


X 


L2 
suy 
f sf 

fo 
ent M 


ji 


PREDICTION OF SUCCESS IN PEACE Corps TRAINING 


havin: А 
Kelley еп variousy estimated from 3% 
» 1963) to 8% (Shriver, 1965). Also, 


ecause 
пена E] Шеш considerations, the ob- 
8 ollow-up criterion measures was 


not p] 
an E 
anned. Because of the urgency oi the 


rese: 

or REM predictions were to be made 
Normally paige Selection Boards, as they 
to develop а a No attempt was to be made 
Or to refine is ron procedures across Boards 
Or purposes ai v procedures in any way 
0 be assumed this particular study. It was 
ceptable : a that the Board decisions had 

alidity. 


D 


EVELOPMEN 
The ei OF THE RESEARCH PROGRAM 
5 i è 
et А invited by the Peace Corps to 
Sip Brora Coordinator for the pretraining 
chole, Contract р ез was to be conducted 
and ists had arre rinceton University. Four psy- 
ment bled a serve as Project Team 
The prd emi ШШЕ for the general develop- 
anq roject Coordi of the assessment program. 
turin, Ssistance t А was to provide guidance 
B o Е о this Project Team in the struc- 
fie ae and was to appraise the 
Week ОП а set e outcome, The Project Team 
Dro 5 after the o predictions to the Peace Corps 
termination of the assessment 
Project Coordinator was invited to 
‚Меш: set of predictions prior to 
€ criterion. 


ШП 
Was Onal ц 


th, Teal cho; 

hoic . 
Stam, Sent si | of Peace Corps programs for use 1n 
ablo lecteg Y was possible. The three pro- 


Wer 
the only ones having а reason- 
ainees and scheduled to start at 


ti n 
1 Pe n ы The Ss consisted of applicants 
acted ki cepted for training for programs 
ооо alvador, and Thailand. They had 


NS eDor 
і m rt " З 
т ent 1 week early to participate in the 


S a Drogr; 

К | (reme they were to leave for train- 
by, ар Versity pi of New Mexico, Northern 
ho, m int, Ss Шо, Hawaii, or Puerto Rico. 
we апд Ad Rem ee to be informed that the 
TAN that нб conducted for research pur- 
me Volu Ы X Жай, of the data would be used in 
mot, Beers wep UU the training sites knew that 
а ding ever, ү to undergo pretraining assess- 
ro ere the atus had no access to information 
Adi askeq tro of the assessment program, 
анте the epus their training and Board 

Ке test; CUstomed manner. 
DAON locatio pu Was to be performed at two 
ET LN laboratory site at Princeton 
ci ty ee ee field site near 
wq, oject C two sites were selected to 
"wy NS Ван. п consisted of Harold М. 
wi; T Bios L Koslin of Princeton Uni- 
unt 9f the University of Colorado. 


of Syracuse University. 


provide an indication of the relative eífectiveni 
the two types of settings for operational 
ment. The samples directed to each pretraining 
assessment site had been selected so as to be 
equivalent with respect to sex, educational level 
and destination. There were 54 males and 36 Us 
males who reported to Princeton and 50 males and 
38 females who reported to Tucson; Two members 
of the Project Team and equivalent junior staff, 
trained as a unit at Princeton, served at each site. 
The assessment program at both sites was the same, 
except for two group activities which were adapted 
to their particular settings, and the language pro- 
grams instituted at each site. The schedules were 
equally demanding, lasting from about 6:30 in the 
morning to about 11:30 at night over a full 6-day 
period. The Ss were organized upon arrival into 
groups of about 18, homogeneous as to sex, for 
purposes of housing, test scheduling, peer ratings, 
and group activities. 

The as nent program was devoted largely to 
instrumentation developed by the Project Team, 
and primarily included semiprojective tests, psy- 
chological scaling procedures, and “complex simulated 
assessment environments.” The last consisted of four, 
specially devised, situational performance tasks, 
briefly described as follows. 

The first task presented S with the problem of 
building an infirmary on the South Sea Island of 
Wabowa. He could ask as many questions as he 
wished regarding the island and its cultures, and was 
to present a tentative solution to the problem of 
getting the natives’ approval and cooperation in the 
project. In the second, S was to describe the system 
of checks and balances in American government to 
a “Venezuelan immigrant" role player, who during 
the course of the explanation revealed a lack of com- 
prehension oi particular points. In the third, S was 
10 assume that he was conversing with a person from 
another culture who had strong anti-American at- 
titudes, and was to argue both sides in the imagined 
discussion. In the fourth task, he was to enlist the 
aid of an “Indian Government official” in establish- 
ing a poultry-raising project, the  role-player 
“official” questionin both S's motives in coming to 
India and his sens ity to the Indian culture, 

The group activities at the field site consisted of 
a rabbit cookout and the construction of a wooden 
privy by each group of Ss. At the laboratory site 
the movie “Mondo Cane” was shown and discussed 
and a community development proposal was pre- 
pared. The Ss were rated by observers during the 
course of these activities. 

Since the trainee’s performance in Peace Corps 
language training is typically given some weight 
by the final Board, a brief work-sample language 
t introduced into the pretraining as- 


was 1 
program by the Project Coordinator.* 


program 
sessment 
ieee 
3 Tnequality of sampl 
to a small number of “no shows." 
4 The two language programs were developed and 
conducted under subcontract Guido Capponi, of the 


e size between sites was due 
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In order to obtain an unbiased estimate of language 
learning ability, the original specifications called 
for the use of a single language that would be un- 
familiar to all trainees, However, the language 
department at the University of Arizona, which was 
to provide training at the Tucson site, did not 
have sufficient instructional staff for such a language 
program. Accordingly, a Spanish program was 
developed for all trainees who had not had more 
than 1 year of high school Spanish, and a Russian 
program was established for those who had. The 
Programs were conducted at the University, over a 
Period of 5 nights, for 3 hours per night by uni- 
versity language staff. The Foreign Service Institute 
(FSI) technique of oral language training, utilized 
in the Peace Corps language training program, was 
employed. At the end of the Program, rankings, 
based on language proficiency, were provided by 
the language staff for all trainees in each language 


A Vietnamese lang 
pared in Washington 


before initiation of assessment, higher 


was rapidly 
(only two 
were recruited 
6-days training 
method and a 


The Princeton lan- 
guage program was conducted over a 3-day period, 


3 hours per day. Trainees were taught in groups of 


developed, seven Chinese “instructors” 
had previous teaching experience) 


SIX, and were assigned to completely new groups 
and new і 


the 3 hours, 


included in the 
tests served to 


each of 
personality components: (a) 
the individual's conceptua] ] 


University of Arizona, was responsi 
program and Paul V, 
Services, Inc, for the Prin 


ble for the Tucson 
of English Language 
ceton Program. The 
the Specifications for 
development of the 
ated the Predictive 
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1). 
tion processing (Harvey, Hunt, & Schroder, b 
Lower levels are associated with fewer persp tives 
and fewer rules for interpreting these pun 
Adaptability was measured by two PRADA E ES 
tests and two situational performance іна pot 
Motivation reflected 55 commitment f intere 
Corps goals as well as the amount О п, an 
shown, his readiness to contribute and lm jet- 
his willingness to take on responsibility and and 3 
ship, and was assessed in all group E al Re 
situational performance tasks. (c) dp pea e in 
lations reflected the traince's ability to jations 
effective and constructive interpersonal re oh 0 
judged by observers in the group дн iy pe 
situational performance tasks, and nd y 
ratings. (d) Intellectual Level was ne generi! 
Scores оп the Peace Corps’ measure » and © 
mental ability (used in original selection) measure! 
lege grades. (e) Language Capacity was us (use! 
by the Modern Language Aptitude Test Ses e 
in Peace Corps selection) and the work-* 
language training scores. осеби 
Through use of clinical assessment ys jid? 
rather than fixed decision rules, “overall n eam] 
predictions were made by the Meron, рои® 
acting much like а Реасе Corps den ne п 
following a careful consideration of the & osi 
ponent scores [Schroder, Harvey, Hunt, " 
1965, р. 25].” "maU 
The Peace Corps had provided the БҮ. e 
with the estimated distribution of Board un samh, 
a scale of 1 through 6) for this particu Шор nt 
of volunteers, and an estimated deselec info! 
(excluding medical Cases) of 16%. This eam P 
tion was used as a guide by the Project й fic 
making its numerical ratings, and in the с Л, 
tion of 18% of the trainees in the ке” ple 
Who were judged to be least likely to 
training. » final га? 
Work-sample measurement. Instructors’ 1 ог oy 
ings were used as the language scores as Ж 
trainees at the field site, Since about twice usy 
trainees had taken Spanish as had бре simi 
the rank scores for the latter group We al al 
multiplied by two in order to provide a 
à hinese st 
scores across languages. For the C the Ё nd 
Program, the sum of the rankings for men т 
hours provided the most reliable measure piace 
Was used as the language score for the E 
trainees, princ f 
It was not possible to merge Tucson and umb jo 
language scores because of the very large у оё у 
tied ranks and the тоге restricted range 0 in gon 
the latter sample (rankings had been pode of 
of six trainees), Accordingly, the мша by Jn 
work-sample approach could be evaluate s 
but not by sex across sites, and identificat! ed 
20% of trainees least likely to be d und" 
Overseas assignment was performed sepa" 
language. pve 
Psychometric measurement. The only, noy 
metric measures considered in the preser ол? 
consisted of scores on four, brief, factored P 


| 
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ста the tests measured personality traits 

ordon, 19 FA 1956) and two measured values 
under sta ons 196ба) 5 АП had been administered 
lion, on ceps instructions and under the assump- 
Would be S: BRE (OP the examinees, that the scores 
Not suffci Considered in selection. Since there were 
fro ciently large samples of the same sex and 
Validation Same site to permit the use of cross- 
i techniques, a priori decision rules for the 


integratj 

established. of the test information had to be 
On t Р 

and j he basis of a review of the available research 


рас 
ance ор essionistic literature relating to perform- 
Sonality be Peace Corps volunteer, certain per- 


ati ad been devised specifically for 
an Of individuals in the lower part 
havi e пер, ange, the resultant distribution had 
hi ШЕ Wege DN skew, with 80% of the trainees 
Cores Те of 1 or less, The 20% having the 
(1.5-15.5) were identified as being the 
© selected f n ignment. 
аз Or overseas assig 
— en Predictions were mide. bY ë 
the, Would hay | 
al wag’ tables e been desirable to have included 


28 ;sis ver 
her th the present analysis. However 


“IN poto jd value dimensions were identified as 
the pe ntially effective predictors of success in 
assigned ы rps program. These dimensions were 
estimat, mple differential weights reflecting their 
these im relative importance. Then, for each of 
ощ Б оаа cut points were established at 
fema] сас апа twentieth percentiles (male and 
коер et = norms), and 1 point was given for 
Percentiles "oen about the twentieth and eleventh 
= Derce and 2 points for scores at about the 
күр for "е or below. The four tests were then 
бай ed o AR trainee by multiplying the points 
BE then EH Scale by the weight of that scale 
Sting Mmating across the scales? Since the 
of motife 


crit 
Rte 


mp, {Зе four personality tests and 
on Ple language ratings were processes 
Were not made available for this 


‚ Вга] 
vith heres do not occur at the tenth oF 
9 ia Points in the published norms 
Values Scales. In these instances, adjacent 
"we as 5 (eg, the twenty-second percentile) 
y е dot Points, 
Stig? орос Scores (of 1 or 2) were multiplied 
ion teq dig, e Weights in order to reflect the 
ү на! importance of the dimensions 
e ers for Emotional Stability, Responsi- 
аңы devo] Sonal Relations; one for Self-Esteem 
Р re and one-half for Support, үн 
teer (Cut Scendency апа Sociability com- 
EUM walts at the eightieth and ninetieth 
EIS ras ad ied for Support.) Also one-half of 
ГАШ d a to the individual's score if 
S, p dimenje made on two or more of the 
EN ideal M of possible relevance: Cautious- 
“aly his indedness, Orderliness, and Recos- 
е ilh approach had been used pre- 
thor with some success. 
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Project Coordinator utilizing only the language 
work-sample scores and the scores derived from the 
1-hour paper-and-pencil test battery in order to per- 
mit a comparison of the validity oi assessments made 
on the basis of a limited amount of information with 
that based on more extensive data. The language 
scores and the psychometric scores were combined 
in a semimechanical fashion, providing a brief 
assessment score for each S in the sample. The 
language score alone was used in assigning predictor 
scores to individuals having a psychometric score 
oi zero. For those individuals whose psychometric 
score was in the lower decile, language was given 
virtually no weight. Both language and psycho- 
metric scores contributed to the final prediction for 
individuals having intermediate psychometric scores. 
In assigning predictor scores, somewhat greater sig- 
nificance was attached to the. Chinese language 
program {ог trainees to be assigned to Thailand, 
and to the Spanish program for individuals to be 
assigned to Latin America. The expected distribu- 
tion provided by the Peace Corps was used as а 
guide in making ratings (1 through 6), and 1 0| 
the trainees who were judged to be most likely to 
be deselected were also identified. 


RESULTS 


Results are presented for all trainees as- 
sessed at the laboratory site and for all but 
five females and one male assessed at the field 
site. None of the six completed the paper-and- 
pencil test battery, and three did not com- 

cuage training. 

s wired indicated, the criterion was 
simply that of having been selected by the 
Board for overseas assignment versus not 
having been selected by the Board. The non- 
selected group included all volunteers who 
had resigned during training, who were 
dropped for medical reasons, and who were 
deselected by the final Board. АП nonselected 

se were included in the lower criterion 
eed since deselection for any cause is equally 
important operationally, representing both a 
d hip for the individual and a loss for the 
c m Also, the basis of nonselection 
"p always clearly categorizable. Some 
" ws who resign would not have been 
d bv the Board had they remained, and 
м ome instances medical deselection appears 


їп the present analyses are all cases 

psychometric predictor data were avail- 
for who a of the six cases with missing predictor 
able. Omiss whom clinical assessments were made 
М biased the results with respect to 
in no essment. Conclusions would have been 


ini asses: | 
i n had these been included. 


^ s Included 
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TETRACHORIC VALIDITIES OF THE Р де 
BY SEX, AND PERCENTAGE Correct or PREDICTED Хо 


Lreonarp V. GORDON 


TABLE 1 


REDICTIONS OF SELECTION 


AND NONSELECTION, BY SITE AND 
ECTIONS FOR EACH PREDICTOR 


| c | | tage 
Site | Sex | | Percen 
i | Total | N” correct 
Predictor = | | 
| Lab Field | Male Female | | 
| | ee 31 58.1 
3 3 3 p: 
Clinical assessment -38* 33* | A57 y^ | p | m 588 
Work-sample measurement | 33* 251% к | H po zi 559 
Psychometric measurement | Ste En 6 | = Shes 31 58.1 
ief asses t ae 2 КТЫ :35 3 | j 
em | 90 82 | 10 69 172 | ! 
` | | i I 
* N' = Number of deselections predicted, 
Fp < 105. 
“p «DI. ў 
а 
to have been based on г 


physical disqualification, 


The respective attrition 
and Princeton sites wer 


with 34.0% of the males and 


females falling into tl 
The overall rate of 35 


than both the Peace 


sample and the typical 
Table 1 provides an 
tive effectiveness of cli 


sample measurement, 
ment, апа brief assessment 
nonselection, The prediction of 


criterion was of great importanc 
Corps and represented 
toward which the pres 
rected. The tetrachoric 
between the dichotomou 
terion of selection ve 
statistically significant 


easons other than 


rates at the Tucson 
e 39.0 and 32.2%, 
37.7% of the 


пе nonselected category. 
3% is somewhat higher 


Corps estimate for this 
attrition rate? 

indication of the rela- 
nical assessment, work- 
Psychometric measure- 
in predicting 
this particular 
е to the Peace 
the primary objective 
ent research was di. 
correlation coefficients 
15 predictions and cri- 
TSUS nonselection are 
for the tota] sample 


for all four types of predictors. ani со" 
predictors are of equivalent validity, та 
efficients ranging between .37 and .41. ct pre’ 
also presents the percentage of corre of the 
dictions of nonsuccess made by oan «amp 
predictor methods. Again, for the tota ae e 
all methods yield results significantly К jl 
than would be expected by chance, pu 
results are of similar magnitude. It "is re 
noted that the psychometric measu" ‚ and 
differentially effective at the laboratory wel 
field sites, These differences may rd con 
have been a function of differences і vali 
ditions of testing :^ While none of jam dt 
ities for the female sample are statistica" E 
—— айй 
1° During the administration of the Pici em 
test battery at the field site, seating ae ade Mot 
Were such that the volunteers did ap Bat im ee ot! 
privacy of response. This could have а c 


ity tes at 
the smaller number of “poor” personality those эү 


rson 


ith (а 
for the Tucson trainees аз compared ed а ic 
= Princeton (despite a higher attrition s dni b 
? The loss rate for the entire sample of 178 Cases as the lower validity of the psychometr 
Was 35.6%, assessment measures for the Tucson site. 
TABLE 2 
Рдорост-Момеҳт CORRELATION. 


PSYCHOMETRIC, АМ 


5 AMONG CLINICAL ASSESSMENT, WORK SAMPLE, 


D BRIEF ASSESSMENT Scores, nv ASSESSMENT SITE ue 
—— See a — 
| Laboratory (N = 90) | Field (N = 82) ues 
Predictor а { x эр 
| m fo | 3 
— ÁN € | Ww | e od Ji: € | (Ww PNE ON Len 
Clinical assessment (C) 35 47 | BET —.02 52 
Work sample (үү) | | | E 


Psychometric (P) 
Brief assessment (B) 


| 
| 


| 


— 
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ni 

o ар are not too different in magni- 
"able 2 hose obtained for the males. 

бт Шоп er а by site, product-moment 
е relatior Mr the four sets of predictors. 

and brief —À between clinical assessment 

36), Of he eee are quite low (.35 and 
eing least cee individuals predicted as 
Were the s ely to be selected by the Board, 

i ame and 22 were unique on each 


list f 

or 

May be anis two types of assessment. It 
the p oted that less weight is given to 


Meson prot language program than to the 
and 57 n in clinical assessment (.25 
Weighted p tively); while brief assessment 

inica] rd about equally (.57 and .52). 
Rent are ¢ Ssment and psychometric measure- 
While "a independent (.07 and —.02), 

easurement assessment and psychometric 

S Would he е highly related (.83 and .69), 
ased on di ee since the former was 

Cor, atter. 
Success fop necting estimated probability of 
басе Cor the entire range of Ss, using the 
Prepared for Scale (1 through 6), had been 
^ ie cii the clinical assessment and 

t orm sessment procedures. Validities, 
P. Bhd E biserial correlations, of these 
‘Cho brief assessment scores with the 
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TABLE 3 


Means, STANDARD DEVIATIONS, AND BISERIAL VALID- 
ITIES OF CLINICAL AND BRIEF ASSESSMENT 
Scores, By SEX 


Male (N — 103) 


Female (N — 69) 


Predictor = 
5 
м | SD | ra| M | SD | fiis 
Clinicalassessment | 4.49 | .80 | 40* | 4.40 | .78 | .22 
Brief assessment 4.42 | .80 |.19 | 4.58 | .79 | .40* 
х B : | 
*p <01. 


having been based on the same Peace Corps 
guidelines. 

Table 4 provides an indication of the rela- 
tive predictive effectiveness of the three 
language work-sample programs, for each 


language group as а whole, and by area of 
Biserial correlations 


intended assignment. 

between the language scores and the di- 
chotomous criterion are presented together 
with the percentage of correct predictions of 
nonsuccess. The lowest 20%% in each language 
group were considered to be the poorer pros- 
pects. It will be noted that on the whole the 
Russian program is significantly more valid 
than either of the other programs, both in 
terms of prediction for all students in the 
in identifying nonsuccessful 


rata} Ото e 
dte Y: Criterion are presented sepa- program and П : 
$$ each sex in Table 3. Clinical as- trainees." The Spanish program has its 
On] has signif кч. = 1 ——— , ae fan deae d 
Уа]; ri cant validity for the ma ЁЗ 11 No precise test is available for etapa the 
n Id y lef assessment has significant significance of differences between biserial cor- 
Oteq «OF the femal ‚ also be relations. By the conventional test for significance 
dicto, "this tabl es only. It may а of differences between product-moment correlations, 
anq Stores h е that the two sets of pre- differences in favor of the Russian pee program 

anda ave almost identical means аге all significant except that of the Spanish language 

rd deviations, each set of scores program for the Latin American group. 
Bi TABLE 4 
SERIAL y n ы AS cnCENTAGE CORRECT OF PREDICTED 


РАК aa 
= хаа 

AS Ответ of case 
s 


[ " SE 
f deselections predicted. 


Total 


| 
Nn’ | Percent 


| | 
Tis | 
| age 
| | wm | ы 
gg | 7 ә 90 | 201 | 18 | 50.0 
26 | 8 000 | 55 док | 11 | 545 
| ‘ose | 2 10000 | 27 | .87** 5 | 1000 
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greatest effectiveness for trainees in the Latin 
American programs (Spanish language train- 
ing was given in these programs). Chinese has 
significant validity only for the group as a 
whole, although it is slightly (but not sig- 
nificantly) better in identifying nonsuccessful 
volunteers in the Thailand program than in 
the Latin American program. Present results 
suggest that while a number of area-specific 
work-sample language Programs might be 
quite effective in predicting Peace Corps 
training success (e.g., Spanish), a single non- 
area specific language (e.g., Russian) may be 
equally or more effective, and would be con- 
siderably more convenient to administer, 


Discussion 


Taking the results at face value, certain 
conclusions are suggested on the basis of the 
Present research. First, there do not appear 
to be any significant differences in the validity 
of predictions favoring theory-oriented clin- 
ical assessment over work-sample measure- 


overseas performance 


Corps volunteeers, the 


instruments 
nder an ех- 
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perimental set. Similarly, Kelly and ЖЫ 
(1951), in their research on the selection 0 
candidates for training in clinical psychology 
reported that validities of certain standat 
groups tests were as high as or higher tha” 
those for the more clinical procedures, à! 
that the more intensive techniques, in ue 
the judges felt the greatest confidence, work 
less well than the apparently more superfici ‹ 
Many people do respond conscientiously о 
paper-and-pencil personality tests, particu dli 
in circumstances that promote honest d. 
appraisal. In the present sample probably 
all trainees were convinced that they ur. 
to go overseas as Peace Corps уйшен, k 
this, in itself, would tend to encourage 
or honest responses.!* 

The clinical assessment. and рвут 
predictions were based largely on ar ad 
tation and procedures that the principa’s Я 
themselves developed, and with УШ, "E 
were thoroughly familiar, thus provic! es 
fair test of the relative effectiveness of i 
techniques in predicting the designate the 
terion. Work-sample measurement, 0? 
other hand, was less optimally représe 
The hastily contrived Chinese language po 
Sram, taught at the Princeton site by а р 
Professional staff, placed this ШЕ, yer 
measure at a disadvantage and proba [ДИ 
sulted in an underestimate of the e il 
of this type of predictor, On the фа re" 
Present findings, it would appear that e 
fully devised work-sample language Р! ес 
in an unfamiliar language might be exp e ol 
to yield higher validities than either i ud)" 
assessment incorporated in the present + re 
The Chinese program did give significa ү 
diction, and the Russian program was 


tric 


nte 
o 


ingly effective, ah 
A number of studies have ЗО ол 
beyond some minimum, the use of а p 


There is some evidence that the large ae gjo 
of information entering into the prt a 
made by the Project Team actually ur 
been handicapping. Being unable to Pa f 
all of their data before the dead! 
eee on 

1? Data for the Peace Corps volunteer )- 
value tests are summarized in Gordon (19 


REDICTION OF Succrss IN PEACE Corps TRAINING 
І D 


forwardi 

rdin, i 

bua Eg predictions, the Project 

set of clinical while later, developed a second 
predictions which incorporated 


a 
of their i 
heir inf i 
OrT Е 
(1965) report mation. Schroder et al. 
2 
The 
, Accurac 
ihe Чоп жуз [the first and second set of] 
addition of х brgsimately the same. Evidently. 
пропел асани; of measures for arriving 
ctions, d . did not give us better 


Actually. add; 

ч келү Adding these scales slightly 

In ^ all discriminating power [p. 31]. 
4 € same r 

the alidities 

Th brief as: 
© clinica] 


an 4 comparison between 
“^а, clinical assessment and 
жек approach is of interest. 
Quire y more duin fh were based on sub- 
qus than the latter and re- 

ао AS compa ation of five score com- 
the Sment, yet Pipe with two for the brief 
sing, 0 types € predictive effectiveness of 
ar, OÍ assessment was quite 


А ser 
Ass Tlous T 
dei ord in the use of clinical 
M Tules th ures is the absence of set 
(Sch os. The at can be applied by other 
Tod Project Team in its report 
al., 1965) states, i 


a No 
бө Бепога] 


ег et 


т 

du combining components is 
i rige overall scores will be 
with Bt cain by a small, 
by. each knowledge of the over- 
ing; e rules trainee and the freedom 
Si Vidua] fa, of component combination in 
Ctors into account [p. 411. 


mittee 


validi 
" Fus the predictions is а 
ie icular individuals making 
assumed that instrumenta- 


(1626 
1960) follow; 


NE: : 
“eng «Stites ee from Cronbach 
"dings S the implications of the 
Particularly well: 


IW 
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Psy s Р s. ose 
longeque and impressionistic assesments] are 
е i erent purposes. When clinical testers 

questions for which their methods ud 
theory are badly suited, their answers are era 
worthless or at best are costly beyond their hon is 
Assessment methods have earned a bad us ls 
themselves by trying to compete with pes og 
ment techniques on their own ground. In th Face 
of excellent research to guide the iioii ge 
iniormation, the wide band technique па 2 
be advanced as a means of predicting E A 
recurring criteria [p. 606]. dian 
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PERFORMANCE GOALS As DETERMINANTS oF 
LEVEL OF PERFORMANCE AND BOREDOM 
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6 experiments (2 pilot studies and 4 main experiments) are reported dealing 
with the relationship of 


of boredom or interest in the tas 
perceptual speed, and Psychomotor с 
min. to 2 hr. In the 2 pilot studies 


significantly related to performance le 


specific goal or score was the major 
experiments a specific h 
more task interest than 


ance within the experimental groups. 


In spite of much anecdotal evidence indi- 
cating that the worker’s production goal 
(intention, quota, or norm) is a major de- 
terminant of his level of production (e.g., 
Mathewson, 1931; Roethlisberger & Dickson, 
1939; Smith, 1953; Whyte, 1955), the experi- 
mental study of the effects of performance 
goals on performance level has been given 
very little attention by psychologists. Thus 
far there have been a few studies which 
indicate that level of performance 15 linearly 
related to the difficulty (or level) of the 
goal. Studies by Dey and Kaur (1965) 


using a letter-cancellation task; Locke 
(1966c) using a "brainstorming" task; 


Locke (19663) in a reanalysis of data 


gathered by Fryer ( 1964) using a code- 
learning task; and Siegal and Fouraker 
(1960) using an experimental bargaining 


task, found (generally) that a 
led to a 


“easier” 


“harder” goal 
higher performance leve] than an 
goal. In Locke's (1966c) study, 
even when the empirical probability of reach- 
ing the harder goal was less than 10%, this 


goal produced higher output than did goals 
Which were easier to reach. 


Even less attention 
effects of qualitatively 
(1935), in a series of 
putation task, found in 


has been given to the 
different goals. Mace 
Studies using а com. 
one experiment that 

! This research was Supported by Contract Nonr 
4792(00) between the Office of Naval Research and 
the American Institutes for Research. The opinions 
expressed are not necessarily those of the Depart- 
ment of the Navy. 


performance goals to level of performance and degree 


ard goal led to a higher level of performance and 
a goal of “do your best.” 
relationship between changes in boredom or int 


- Tasks used included simple addition, 
oordination. Trial times - 
postexperimental goal descriptions were 
vel, and Ss indicated that trying for a 
source of task interest. In the 4 main 


There was no consistent 
erest and changes in perform- 


shel 
nigh 
a goal of “do your best" led to а ass? 


гр 

level of performance than a goal E a її 
Score representative of S's previous ; ri cf 
ance or than a goal of doing a ize en wil! 
of computations. In a second ae Н 
а similar task he found that T 
Specific goal each day based on his солі 
ability and on the performance Pet tha 
group vielded a higher performance east | 
a goal of “do your best.” An exper ntl 
Locke and Bryan (1966) using а " Wi 
Psychomotor coordination task pe w 
Ss given a specific hard goal on pet 
performed better than a matched £ | 
Ss told to do their best, pj 
The first major purpose of the есі ue 
studies was to further explore the € gno 


Ш 
y 


Pi i erio” g? 
qualitatively different goals on k than И 
utilizing a wider variety of goals b 


x bis: orts 0 
used previously. In addition, eff E 


made to control for differential i. 
Tesults among the different goal en ee 
the study by Locke & Bryan, 1966, of ү 
with hard goals also had knowled eid, К 
but the do-best group did not). » a 
generality of goal effects across cca 
was of interest, Finally, the lene ay 
trials used in the present studies » vio" 
longer and shorter than those used I e ec! 
by Mace (20 minutes); thus the ould 
goals as а function of time spa? 
explored, he P 
А second major purpose of 06 y 
Studies was to examine the effects 0 
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tively dj 

ud aea goals on degree of boredom 

evidence Е T the task. Again anecdotal 

Wyatt, Tr s there is to go on. In 1934 
» “rost, and Stock wrote of a group 


of f 
. dactory 
к workers w 
Mmtensively; kers whom they had studied 
One 
Of th 
0 М em fr 
Perative Ost frequent devices adopted by the 


5 for th 
: е Г 
purpose of relieving boredom was 


е cre 
ation 
ey of defini А 
а efinite : - 7 M 
Units attempted Qo Ñ e aims. From time to time 
omplete a certain number of 


in i 
the а given peri 
S p» of peus dm i arranged the material in 
Ip. sq her during d esigns; or competed against 
` short outbursts of great activity 
Ro 
y (i ; 
the m Why ve 
по cYalence ы 1955, рр. 28) describes 
reg On: piec goal-setting activity among 
5 Че о а or systems and 
g о d 5 
о work for. Р effects of having definite 


e 
to Only experi 
by € aut бок study on this topic 
hoy. Ocke lage iege was a pilot study 
So b) of 22 Ss working for 5 


t 
‹ 


t 


T 
p th 
The ог 
studi 


80. 
» Senior 8 uch as “do your best.” 

(E) in e served as the experi- 
so, main i Second pilot study and 
Ss сед as gunt, and the junior 
es Ге run бр the remaining studies. 
idu Nd in the f groups in the two pilot 

LUE p aed e experiment, and 

€ last three experiments. 


T 
LS Prror Srupy 1 


S pil 
tto, Pai Ot s R 
ч р" vo ope involved 47 male and 25 
De sec i чаш recruited from five Wash- 
ttj d niae oe The Ss worked for 
ч De agile oce taal and den 2-minute 
баер тсе Moran „°P a number si Sk de- 
t цар 2? and Мей er-crossing task © 
Sheed Mefierd (1959) as a measure 
ог; . Th А аз а 
п а ro AS 55 task was to cross out 
a is like the number circled a! 
LEN Sea, of random numbers. И 
Мис, mental conditions were dif- 
15 given to different groups of 
instructions to “do your 
du comfortable расе,” tO “try 
à score that is 8 more than 


° 

be bo « 
at “Wor, fron 
оп RS at E 
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E = score on the 4 practice trials.” А 
s on the períormance scores of the. differ : 
experimental groups showed no effect of red 
instructions on. performance. However, res ye € 
postexperimental goal checklists indicated ‘thei | = 
than 24% of the Ss were pursuing their а i m 
goals. Therefore Ss were recla fied acco ie 
these postexperimental goal беспридп Ri E E 
cation yielded the following five goal eat Бел d 
High-standard group QUSS). This meum 
composed entirely of Ss who ienei ter. Hey 
were trying to reach or exceed the goal of eight Eo 
correct rows than they had completed on ‘the {ле 
These Ss actually reached ог excede 


practice trials. 
their goal on 5% of the trials. 

High-im provement group (N —16). The Ss i 
this group stated that they were trying to ‘beak 
their best previous score by one or more rows 24 
each trial. These Ss reached or exceeded their goals 
on 21% oi the trials. ERAS 


L improvement group (N =12). This group 


consisted of Ss who were either trying to equal 
their best previous score (N =4), trying to beat 
their immediately previous score (N = 6), or those 
Ss trying to equal their immediately previous score 
(№ = 2). These groups all had in common the fact 
that their improvement goals were less difücult 
than those of the high-improvement Ss. These Ss 
were able to reach or exceed their goals 39% of 


the time. 
Do-best group (N= 


22). The largest a posteriori 
group was composed of Ss who indicated they were 
trying to do their best without regard to their 
assigned standard or to their previous scores. 
Miscellaneous low-motivation group (N = 9). The 
Ss who stated they were working with “ше effort,” 
rying to complete the task," or “working 
for accuracy,” etc, were placed in this group. 
] in common the fact that they ap- 
o be highly motivated and had no 


titative) goal in mind. 
ose goals did not fit 


re dropped from 


"just t 
mainly 
These Ss had 
peared not t 
specific (quan 

Of the original 72 Ss, 4 wh 
in any of the above categories We 
the analysis at this point. 

The relative mean improvement scores (over Ss’ 
scores) of each a posteriori goal subgroup 


consistent across experimental con- 
seemed permissible to combine the 


across conditions. 
formed on the mean improvement 


practice 
were reasonably 
ditions. Thus it 


An F test pe ‹ 
scorex GP the: BE groups (analysis of covariance) 
F ratio of 728 (р < 001). The ordei 


yielded an 

m improvement was: (1) High Standard; (2) High 

Improvement; 3) Do Best; (4) Miscellaneous Low 

Motivation; and (3) Low Improvement. The t ratios 
than 2.20 for individual com- 


which were greater 
of means were: each of the first three 


parisons 
Marsus dE last group and the first versus the 
fourth. 
This study suggested that performance goals 


could be used to account for differences in level of 
performance among groups. It also indicated the 
importance of determining whether or not Ss are 
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actually trying for the assigned goals (ie., following 
instructions) before drawing conclusions about the 
effects of experimental conditions. 

A bipolar graphic rating scale for boredom- 
interest was given to cach S after each experimental 
trial. Analysis of the mean interest Scores | for the 
ratings on 10 trials combined did not yield any 
substantial differences between the a Posteriori goal 
groups. However, when asked to list their reasons 
for being interested in the task, over 56% of the 
Ss gave “trying for a specific goal or standard” or 
“trying to improve over my previous score” as 
a reason. This was by far the most frequently 
given category of response, Also Ss who listed 
“trying for a particular goal or score” as a source 
of task interest were significantly more interested 
in the task on the 10 experimental trials than were 
those who did not list it (z = 2.97, p< 01). 


Por Stupy 2 


The second pilot study used the same Ss as in 
the first study, but the task in this experiment was 
simple addition modeled on Test N-1 from French 
Ekstrom, and Price’s 
nitive factors. 


Again, all Ss were given four 30-second practice 
trials followed by ten 2-minute experimental trials. 
As in the Previous study the experimental con- 
ditions were the different goal instructions given to 
different groups of Ss. These ranged from instruc- 
tions to “beat a score of 8 more than your total 
Practice score,” to “do your best,” to “beat a score 
of 6 less than your total practice trial score," 

Again, no significant effects of experimental con- 
dition on performance were found, but it 
found from postexperimental 
less than 4296 oí the Ss 
signed goals. 


] 
(1963) reference kit for cog- 


was 
goal checklists that 
Were pursuing their as- 


found between Groups 1 а, 
and 3 versus 4 and 5 combined. 

Like the previous study these results suggested 
that performance goals could be used to account 
for differences in level of Performance among 
groups and that it was important to determine 
whether or not Ss were in fact Pursuing the goals 
they were assigned. 
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A single boredom-interest questionnaire gives A 
the end of the experiment did not differentia E. 
nificantly among the a posteriori goal Pking 
However, over 61% of the Ss Ge Ме: 
toward a goal or standard" or the wu 
improvement" as a cause of interest in E 
Again, this was by far the most frequently те 
source of task interest. tw? 

The most obvious problem with n o 
studies, of course, has to do with the er 
the postexperimental goal descriptions. It + a gol 
be easy to defend the argument that, Ulo 
descriptions were entirely post hoc peo e 
of S's performance. First of all, the post a in 
of "do best" would not really explain pest got! 
Second, some Ss (those trying for the hig ail 
in each experiment) checked goals that they: " sus’ 
less than 5% of the time, which would ha n 


^ pina! 
gest a rationalization of actual Beanie rd Ded 
Previous findings (Locke, 1966c) that mance 


(experimentally manipulated before peers are in 
lead to higher performance than easy £02 nding 
agreement with some of the Өш. 
Nevertheless, the possibility remains tha олай 
in the previous two experiments were ЫШ ad 
their performance rather than descri vert do, 
actual goals. Thus subsequent studies V goals st 
taking more care to get Ss to try for 
before the experiment. Р 

It was decided, in the next bear wt. 
the same two tasks that were used in the oals шү 
studies but to emphasize only two of the stand j 
previously. The ones chosen were the hig two yi 
or hard goal and the do-best goal. These perf?" " 
had not produced significant differences (a cases the 
ance in the pilot studies, though in bot ^ ci pe 
hard-goal Ss did better than the do-best S% pe W 
next two experiments it was decided tO eter 
experimental trials considerably longer t9 D do, 
Whether the superiority of thc hard-goal tually 
Ss would become significant when e (pe w 
allowed more opportunity for motivation? vious ү 
ence) factors to come into play. The pre ialsi "i 
Studies had only involved ten 2-minute еп ji? 
two to follow involved single trials betwe 
2 hours in length. 

Another reason for choosing the T 
do-best goals was that Ss in the pilot 
dicated that trying for specific goals we g 
source of task interest. The alternativi act Fil 
for a specific goal is trying for some 829? „(д he 
such as “do your best.” Even though, wee” ye 
differences in boredom did not emerge lot ШУ 
hard-goal and do-best groups in the ae 10 
it was felt that they would with longer 


some А 


ug 

10 
tw? 
e 


К 


i 
iudi jo! 


EXPERIMENT 1 


METHOD 
Subjects olti 
volt ў 
The Ss were 41 paid, college-student 5 d Ў 
recruited from the University of Ma mî 
fall semester, There were 26 male and 
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Task 


The (| 
ask was 
perceptual speed as described in Pilot 


Study 1. Ty. 
Pages x ue however, there were 60 numbered 
Scoring, S Aele instead of 20. To increase case 
а ine, the rote, in a blank space at the end of 
matched the phot NE of digits in cach line which 
Te. matching сеа digit (rather than crossing out 
ще ант: The Ss began with two 
e their best В on which they were told 
the pled, and $ our 60 pages were in one pile, 
Pile before | put each completed sheet under 
Pro, beginning the next sheet. 
cedure 


being с. CONtinuous 

make interrupted 25 for 13 hours at the task, 
hag, tings of boy, briey every 15 minutes to 
дш hed in кр and to mark the point they 
Where, Маз а bi booklet. The interest-boredom 
ftom m at vario ipolar, vertical, graphic scale 
Ing» (h Was min points by statements ranging 
task i ely boring" to “it was fascinat- 


Wa 5 

min terest Ppa asked to describe his degree of 

Ong р. Detloq,) oredom during the previous 15- 
measure very similar to this 

Previously to agree well with 


Casur 
es of 
boredom for industrial workers 


Dog, 1955), 


D у conditi 
bug POP told ae 017). The Ss 8 this 


В o 
vie Tour period, У problems as they 
Petformance айо (N = 24). On the basis 
i Set up sh the do-best Ss, a table of 
so eq yo do-best CHE the obtained 13-hour 
Р Оооо iO eee abilities as 
end-go re scores. The actual means 
бей; Ss were the total attempted 
Otal Correct ло! were about 13% higher 
f a ores for the do-best group: 
ay ed pu beating ances Ss were offered a $1.00 
К, soir "expected" mean score 
al bonu. 5 Of their initial ability) and 
i wont Ss A $1.00 for beating the mean 
| With this i the next higher initial ability 
RN o а 1огшаноп in mind, еа 
tity бап үр With icate in writing what his own 
* b Abiti. the Mea e stipulation that it be no 
аза op” (The 4 score of do-best Ss of MS 
Petforme ruses were to be paid on 
Set.) ance, regardless of where the 
terms Ss were reminded that their 
Ing үр. Should of number correct and that 
t ori goals allow some leeway for error 
em The Ss marked the page іп 
qx Sheets corresponding to their 


ire *dminj 
E istered a postexperimental goal 


"cce te Resutts 
ъ ee Of the 17 do-best Ss, 11 
St alternative on the post 
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experimental goal questionnaire. Four addi- 
tional Ss indicated they were trying for a 
generally equivalent goal (eg, "speed"). 
Two Ss set themselves specific high goals in 
terms of the number of pages they tried to 
complete. Of the 24 end-goal Ss, 21 set them- 
selves goals which were harder than the norm 
sheets indicated they should make on the 
basis of their initial ability; the remaining 
3 set goals appropriate to their initial ability 
according to the norm sheet. All end-goal Ss 
indicated on the postexperimental question- 
naires that they were trying for their goals 
(or some score close to it) for part or all of 
the 90-minute period. Only 2 of the 24 Ss 
actually reached the goal they set at the 
beginning of the experiment. 

Performance. Figure 1 shows the mean 
number of rows correct for each goal group 
for each 15-minute period on the perceptual 
speed task. It is clear that the end-goal group 
showed a higher level of performance than 
the do-best group from the first 15-minute 
period on, with the size of the difference in- 
creasing substantially during the 90-minute 


period. 


The mean improvement in terms of rows 


he prorated practice scores (on 
which the two groups were not significantly 
significantly greater for the 
than for the do-best group 
, p< 1002). If the two do-best Ss 
i they were trying for specific 
end goals are dropped, the £ ratio increases 
to 4.01 (P € 1001). The / ratio using linear 


Jope scores Was 4.50 (p < 001). 

е To the average the end-goal Ss scored 996 
the do-best Ss, the range being 

. Of the 24 end-goal Ss, 17 


Ss of equivalent 


sult of compar 
pn d set themselves end goals. 


boredom. There was some evidence 
goals increased interest in the 
task as compared to the do-best goals. The 
mean interest score of the end-goal group was 
greater than that of the do-best group for 
each of the six 15-minute periods; however, 
the £ ratio for the difference of the means 
for all ratings combined was only 1.82 
(p< 10). The slope of the two boredom 


Interest- 
that specific 
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reached their subgoals 50% of the time, and 
six of the nine subgoal Ss reached or exceeded 
their end goals (ie., their eighth subgoal). 

Performance. Figure 2 shows the mean 
number of problems correct for each experi- 
mental group for each 15-minute period of 
the 2-hour session. It can be seen that the 
end-goal group showed the highest level of 
performance and that its superiority to the 
do-best group increased during the experi- 
ment, reaching a peak after 14 hours. The 
subgoal group's performance was between 
that of the end-goal and do-best groups. 

The end-goal group showed a significantly 
higher mean linear slope in performance than 
the do-best group (£ for matched groups — 
2.46, р < .05) and got a significantly greater 
number of problems correct (# for matched 
groups = 4.50, p < .001). Only one end-goal 
S failed to beat his do-best counterpart; and 
this difference was only —18 (or —2.5%), 
Whereas some end-goal Ss beat their do-best 
counterparts by as much as 350 (or +32%), 
the overall average being 2095 more problems 
Correct. 

On the whole, the subgoal group did not 
differ significantly from the end-goal group 
nor from the do-best group though the latter 
difference favored the subgoal group. The 
t ratio for the mean linear slope of the sub- 
goal versus the do-best group was 1.71, and 
for number of problems correct it was 1.46 
(ns). (The ¢ ratio for total correct in the 
middle hour was 1.90, № < .08.) A possible 
explanation for the lesser effectiveness of the 
subgoals as compared with the end goals is 
that the subgoals may have actually slowed 
the pace of some Ss. The subgoal markers 
yielded feedback about S's progress in rela- 
Поп to his assigned goal; and E observed 
that Some Ss seemed to use the subgoals as 
limits rather than as minimum guidelines, 
trying to increase their Speed if they were 
behind, maintaining their pace if not. In fact, 
Six of the nine Ss scored within 10% of 
(above or below) their do-best counterparts. 
In contrast, the end-goal Ss did not have 
such exact knowledge of progress and, in the 
face of such uncertainty, may have wanted 
to reach their end goals as soon as possible. 

Interest-boredom. The results for the in- 
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terest-boredom ratings were E. 
for performance except that the en pe 
subgoal groups were even e н 
The end-goal group showed a ж-а the 
higher linear slope for interest tha i M 
best group (¢ for independent ТАГ 
p < .05). The corresponding ? 2 (p! 
goal versus do-best group was 2.0 tro 
Similarly, the mean drop in interes | | 
first to the last 15-minute period M. Г 
the end-goal and subgoal groups en 
the do-best groups (£s for а pet 
groups = 4.61, р < .001; and 2. d rat 
respectively). Total interest for T 
combined was significantly деши 
two goal groups (combined) tha 
do-best group (£ = 2.12, p < .05): 


Discussion 


pert 
The results of this experiment, S 
monetary incentives were used to gigni o 
acceptance, were, in terms of the sat? D) 
of the goal effects, equal or super i 
of the previous experiment. Partic resen! ў 
respect ќо boredom-interest, i a i 
sults suggested a substantial елар 
task interest for the specific 904 if 
compared to the do-best group. y 
The final two experiments a " 
parison of the same two 808 m en y 
previous two experiments, but ls for if 
here will be on reporting the as Cal 
dom since the results for peron i ed P 
completely replicated those О 
ously) are reported elsewhere. 


Ci 
а? 
уе! in 


ult 
The design and performance ral ip p. 
experiment are reported in "s tas u 
and Bryan (1966). Briefly, t pich q^ 


) 
core! ү, 
were given specific hard goals (еше it 
for on each of twelve оя che ( 
14 matched Ss were told to Hie, Poa 
on each trial. All Ss were mero th f 
participation only) volunteers e 
versity of Maryland. ce, d 

M E the perform ей ly 
briefly, the hard-goal Ss er do ү 
significantly higher level than a, OF 
using both linear slope sco” 
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Scores eee 
ES VV ы As in the previous two 
groups fiiia difference among the two 
All Ss were ios the experiment progressed. 
rating scales 1, ministered boredom-interest 
Wo studies d ; e those used in the previous 
ard-goal S; wie each trial (and before the 
ky beaten ib told whether or not they 
mi ыя goals). The results are 
: n : 
Mereaseq r5 previous two studies, boredom 
Сазе the ans for both groups. In this 
atings or tegis in mean boredom-interest 
experiment e groups also increased as the 
est score went on. The mean total inter- 
nificantly of the hard-goal group was sig- 
poe i бер than that of the do-best 
but po PSS ios Eam in mean overall 
1-3 16 Mean diffe edom was not significant, 
Thi nly was ўы тепсе in slopes for Trials 
найн маб. sum at the .01 level. 
medio increase p etween the two groups in 
at а бег ии was almost im- 
Sut the sam rial 3, boredom increased 
е rate for both groups. 


EXPERIMENT 4 


© final А 

s Darately е ee was designed to 
d and the eff e effects of knowledge of 
in y. POowled ects of goal setting оп bore- 
anq еше € of score had been controlled 
ables Нес of 1 and 2 but not 3. The design 
sg, n Perfo the knowledge and goal vari- 
эйе (Lo rmance are reported in detail 
as 21у be i iss 1967, in press) and thus 
"ple ane here, Briefly the task 
j p as in Pilot Study 2 and 
Par i ga design was a 2 X 2 fixed 
те Versus ү, variables were knowledge 
pitte ү лага no knowledge of score an 
Be eee hee versus do-best goals. 
NS Toup of ni Ss in each of the four cells. 
jM АШ ӨН Ss was matched with each 
est) © е ability on the task 
Oward qp of attitude (liking and 

teg Sep. the task. Each 5 worked 
ad arated by rest pauses) which 


ath bet 
| Siding үп 10 and 15 minutes 17 
x The 


n 
8 1 hour's working time). 


bore- 


*Xpla 
S nati 

for т, ОП of why there were no = 
1966. 


па 
1 7, see Locke and Bryan: 
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Mean Interest-Boredom Ratings X Goal 


Fic. 3. 
igher scores indicate 


Condition (Experiment 3). (Н 
greater interest.) 


ers on answer sheets each 
of which they passed to E, through a hole in 
the wall of the experimental room, after the 
task was completed. The problems were on 
5 cards put consecutively in a 
box. The knowledge-of-score Ss were told the 

er each trial. The 
not. The do- 
old to do their best on each 
ven goals be- 
d index cards 
int in the 


Ss wrote their answ 


to here to reach your goal." The S was not 


told, however; how many problems this in- 

volved. After each trial 5 was told whether he 

beat the goal (and was oF was 

actual score depending on his knowledge-of- 

score condition). The goals of the hard-goal Ss 
1 bout 1196 to the scores 


alternating trial length and 
their answer sheets was to 
prevent do-best and no-knowledge-of-score Ss from 
knowledge of score and from setting specific 
goals (e£ 2 «jmprovement”) on the basis of 

ji es. The task structure made it 


their prev - 
! hese Ss to keep track of their 


very difficult for t a 
progress (e£ problems correct per minute) or to 


get any exact idea of their actual scores. 


4'The purpose of 
having Ss hand im 


TABLE 1 


RELATIONSHIP OF BOREDOM-INTEREST LINEAR SLOPE 
Scores TO PERFORMANCE LINEAR SLOPE SCORES 
IN 4 EXPERIMENTS 


Experiment | n Goal group r 
1 17 Do best 05 
| 24 End goal —.002 
2 9 Do best 58 
18 Subgoal and 
End goal —.11 
| | 
3 14 Do best —.25 
14 Hard goal —.07 
| 
+ 18 Do best | i52» 
18 Hard goal | 35" 
| 


a А positive correlation indicates the less the decrease in 
interest, the greater the improvement in performance. 
* p «.05. 


obtained by matched do-best Ss on cor- 
responding trials. Boredom scales were ad- 
ministered after each trial. 

To summarize the performance effects, 
there was no effect of knowledge of score on 
performance; but there was a highly sig- 
nificant effect of goals, in favor of the hard- 
goal condition. 

The boredom-interest data were analyzed 
in several different ways. First, using total 
boredom scores there was no effect of either 
variable. However, using linear slope scores 
there was a significant goal effect in favor of 
the hard-goal group (Р = 4.33, р < .05). 
Using the difference between S's boredom 
rating on the practice trials and his mean 
rating on the five experimental trials yielded 
no significant effect; however, using the dif- 
ference between his practice trial rating and 
his mean rating on the last two trials yielded 
5 P < .07) in favor of the 
There was no effect of 


те on boredom for any 
method of analysis, The differential effect of 


the different goals on boredom did not emerge 
until the last two trials: on these trials the 
do-best Ss increased in boredom considerably 
while the hard-goal Ss decreased in boredom 
(increased interest). The later emergence of 
the goal effects in this study is probably due 
to the fact that the trials were shorter than 
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2 iment 
in Experiments 1 and 2. Also in сосе 
3, the boredom difference did not M 
substantial until after an hour had pa i 

Previous research has not given ae 
support to the idea that attitudes an all 
formance are strongly related (e.g., ME 
& Crockett, 1955), but most previous > 
have dealt with satisfaction or liking redom 
job or task rather than interest and "e 
They have also dealt with static See t 
relationships between attitude and р vel 
ance variables rather than dye ain 
tionships (ie, relationships among elation" 
scores). In the present studies pow mai 
were computed for each of the pide 
experiments between linear slope TE fof 
boredom-interest and linear slope "e ато! 
performance within each py wit 
The results are shown in Table 1. Т chang” 
no significant relationship between ЕЛ E 
in interest and changes in performances the 
of the eight experimental subgroups © ine! 
average correlation for all groups P ойле it 
was only .18. In terms of group Maer at 
was typical for performance level hed M 
at the same time that task eran ой 
decreasing, just the opposite of ho ой 
be expected if attitude changes ow г, 
related to performance changes. In ег о 
ent studies S's goals affected both e p 
ance and boredom, but the latter V 
consistently related to each other- 


DISCUSSION 


po" y 

The results of the six experiments M 
here strongly support the idea that Ped ff 
ance goals are related to and can e n" 
account for level of performance 0! o \ 
ber of different tasks. The results gg 
pilot studies indicated that postesP jase d 
goal descriptions could be useful in ! ass А 
ing Ss who were not trying for their 75. w 
goals. Experiments 1 and 2 suggest 


See% LIES EFL 
x 5 = = 
x. 
ел т SE 
a 


wD 
AUS а 

I, eV RS = 
а 2ш 


level than Ss trying to do their : 
finding agrees with the performant геро, l 
of Experiments 3 and 4, which n hal д 
elsewhere. These results also sugges of “g 
financial incentives offered to oe пе 
attainment in Experiment 1 were ! 


PERFORMANCE GOALS 


sary to achi 

finding о results since the same 
in three other io without such incentives 
Ypothesis for E An interesting 
alloen. | uture research might be that 
“bon goal beo conc which are contingent 
ance Шер ainment do not affect perform- 
mainly to co or automatically but function 
values the emi S to the goal (providing S 
to compare centive). Tt might be worthwhile 
Cehtive fa effects of an all-or-none in- 
Score js reach one given only if a certain 
Dlece-rate m as in Experiment 1) with a 
. Piece or наа where S gets paid for 
de group cmm One original experi- 
diq atter type of ilot Study 2 was offered 
sg, t Perform incentive, but this group 
orginal he better than any of the 

Pres po 
Nore @ a suggest what might be 
aie fian v ag of motivating indi- 
and pica in = them to do their best. 
tions ilitary жы, industrial, educational, 
есу ince people ng and performance situa- 
Might than to oe to respond better to 
taiseq e он stract goals, training time 
y ind bos Ps and/or productivity 
d to set determinate goals. 
s p this to be true on à 
" "s er Locke (19662) 
hese data found that it 


Or: ant 
to " 
Ap jS Ate set, control the Zevel at which 


ln М Caring р 
Wag „ап Е 
às ра 1а1узі 


of 

Ras main experiments found 
h ч » Decific performance goals 
! the task reater or lesser degree) in- 
on (do. compared to Ss with no 
З -best Ss). The effects of 


of 
th 

tr le Test 

Ni XPerime seem to grow with the length 
ea eod ht and/or the length of the 
д ген vide hese results support the 
ЧУ (in а oe (1934) 
in om S сд hyte, 1955) that setting 
КИШ is h, function as an antidote to 
haè b Situation, possible implications for 
n p ns. Tt might be possible to 


q Ng don 
do iier many repetitive tasks by 
Sur, aie S determinate goals each 
o deter Further research woul 
nye оша Tmine at what difficulty 
е ideally Бе set. Previous 


Ock 
cke, 1966c) found that the 
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highest productivity was achieved with th 
hardest goals. On the other hand, Dey d 
Kaur (1965) did find a slight drop in ы 
formance for their hardest goal group (thi уа 
the significance of this drop was not ien 
In addition, Locke (1965, 19664) found п 
the hardest goals lead to the lowest deg a 
of satisfaction with, and liking for, the a 
Since dislike for the task is liable to lead, 
eventually, either to apathy or to turnover 
(Locke, 1966b, found that failure to reach 
kes S less likely to want to perform 
again), some compromise would be 
to achieve both high output and 
(in Whyte, 1955, p. 34) 
Is of moderate difficulty 
ctive in getting individu- 
rate work. 


goals ma 
the task 
necessary 
satisfaction. Roy 
suggested that goa 
were maximally effe 
als involved in piece- 
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tai › 
little from supervisors, peers and su 
e relationship between supervisory Tà i 


о М 
п most variables. Using a double cross 
terion ratings a 


ss validities were obt 
where correlations 0 


Lid developed for each of the cri 
vnd debt sample. Significant cro 
а iction of the creativity criterion, 
across the 2 subsamples. 


Th 


Bi idus se i 
Com omipetens eon and prediction of scien- 
чёп е ы especially creative scientific 

Stalking H a difficult and hazardous 
anq p € howe of it is quite apparent 
our ПаЧоп q of our progress as a society 
Rega eative epends to a great extent upon 
x scientific talent in all fields. 


In d В 
the 12 definite progress has been made 


= 
к 
e 


ae 35 Predictor data. 
tion ing t A more recent studies demon- 
Sen the {ше of biographical informa- 
ot Rue "Es entification and prediction of 
Glen, Derg — and creativity are those 
un (1991. Owens (1960), Albright and 
(1961) P. Smith, Albright, and Glen- 
(95 > апа zhambers (1964), McDermid 
). aylor, Ellison, and Tucker 


autho 
noc a4 Would like to express great ap- 
a Sessions, Dan Anderson, and 
anal their considerable assistance in 
or Rite o like yzing the data. In addition they 
i har rendered p make note of the invaluable 
Stug, ds n-M by the management and personne 
y Could *rrell, Inc., without whose assistance 

never have been accomplished. 


loge: 
Woytting ЧСКег 
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(BI) was administered to 157 pharma- 


gned to 2 groups of 79 and 78 Ss 
n the BI was correlated with 19 


{ the scientists. These primarily involved 
k produced, skill with people, etc., ob- 


bordinates. There existed remarkably 


As indicated in these studies, the over- 
whelming majority of past research in the 
area has been in engineering and the physical 
sciences. As à result, there are at present ex- 
tensive biographical descriptions of the more 
creative and competent people in these fields. 
However, with the exception of Roe (1951, 
1953), and a few others, little of this research 
has been concerned with other types of pro- 
fessional people; such as those in the biological 
or pharmaceutical sciences. 

This study was undertaken to determine 
whether biographical characteristics also 
could be found and utilized effectively for 
the prediction of performance criteria of 


pharmaceutical scientists. Since pharmaceu- 
tical scientists engaged in research and de- 
al widespread in- 


have а potenti 
e general public through the 


products they develop, it is crucial that the 
best scientific talent available be selected to 
fill these positions. A secondary purpose of 
this study Was the development of a valid 
biographical inventory which, hopefully, would 
aid in the identification and selection of such 


high-level scientific talent. 
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METHOD 
Subjects 


There were 234 employees of the Richardson- 
Merrell, Inc., pharmaceutical company who partici- 
pated in the study. They were employed in the 
scientifc division of Vicks Chemical, the Merrell 
Drug Company, and the National Drug Company 


TABLE 1 


LIST OF CRITERION MEASURES OBTAINED ON 157 
PHARMACEUTICAL SCIENTISTS 


Ratings Variable 


Supervisory ratings 1. Quantity of work 
produced. 
- Skill in getting along 
with people. 
3. Creativity. 
+. Overall work 
performance. 


to 


Peer ratings 


[I 


+ Quantity of work 
produced. 

6. Skill in getting along 

with people. 


7. Creativity. 
8. Overall work 
performance. 
Combined supervisory, | 9, Quantity of work 
peer, and subordinate produced. 
ratings 10. Skill in getting along 


with people. 
11. Creativity. 
12. Overall work 

performance, 


Criterion measures derived | 13 


- Tenure I (months em- 
from company records 


ployed by company). 
14. No. salary increases. 


Rankings as provided by | 15 


S . Rank (supervisory), 
Supervisors and peers 16 


- Rank (peer). 


Supervisory ratings from a | 17 


огу ‚ Creativity checklist. 
checklist Instrument 18 


- Likability. 


Performance rating pro. | 19 


I + Psychologist’s ratin; Е 
vided by research team = 


Control measures not in. 20 


- Tenure II (months 
cluded in the BI pre- under present Super- 
dictions visor). 

21. Percentage of time 
Spent working with 
supervisor, 

| 22 


- Degree of confidence 
expressed by a rater 
in Providing a per- 
formance appraisal. 
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at the time of the study. Through the eger. 
of females (who were too few in amber) ^. wd 
those classified аз technicians (whose ARE nidis 
so routine as to preclude opportunities for oH 
tion, creativity, etc.), as well as those ШШ eats 
there was incomplete data, a total of 157 к= 
remained in the sample, all of whom ps 5 
ranging from BA or BS through PhD or 1 IS ( 
The following presents a breakdown of ) tenure 
ages, (b) academic degrees obtained, and а 
with the company for the remaining sample. 


а) 


(a) Age breakdown: 

a people were under 26 years of ae 

48 people were 27 to 34 years ої od 

48 people were 33 to 42 years ol age. 

35 people were 43 to 50 years oí age. 

14 people were over 50 years of age. 

M age = 37 years. Ре 

cin deam of academic degrees айан 

42 people had received а ВА or BS ^ етте 

35 people had received the Bachelor n no 
and had some graduate work, 
graduate degree. ree 

9 people had received an MA or ы v he 

12 people had some graduate work be} 
Master's degree. d 

39 people had the PhD or MD degr 


(5) 


(c) Tenure information: any was s 
The minimum time with the compa Р 
months, y wir 
А апу 

The maximum time with the сотр : 
33 years. any wa 

The average time with the comp: 
89 months. T 
е scien ie 
In relation to each other, these dto 
Occupied either Supervisory, peer, or SU? ctf 


ner i rchi str 
Positions, so that most of the hierarchical 
Was represented, 


Data Collection 


lable ii А гете Те! pf. 
ance criteria in these NASA studies Wc! h B 


? геге 40 
Other items also were included which кл 
logical, or empirical E ей 
be related to competence and creativity. пілі" т 
At the same time the BIs were being ad ud 
criterion data were collected on each scien E vis? 1 
on-the-job performance ratings by their SUP, able q 
Peers, and, in some cases, subordinates. ора! 
Presents а list of the criterion measures 
from these ratings, 71 
With the exception of Variables 20, 2 i 
(which Were used for control and validity тег NI 
all of the measures presented in Table ! гера" 


included їп the biographical analysis à? ^ 


1 
2? 
а nd s) 

m» i 
rr pt, 
re ү 


J a а а ааа 
R o 
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criteri 
ipd, ins Variable 20 was used to check the 
1 Wüs deed xc supervisory ratings, and Variable 
Variable 22 d part of the Likability criterion. 
Check ihe тб used as a control measure to 
at is, if a иу of all performance appraisals; 
a Particular mu was not very confident in giving 
appraisal] wie oa ormance rating ог appraisal, that 
ot used in the study. 


Procedure 


he cries 
determing (pn measures were intercorrelated to 
Variables а ae extent of overlap among the rating 
4 le s ratees and raters. 
В їп lig was then performed upon the 
Б, а bise ial each of the criterion measures; 
n 0 for н d correlation coefficient was com- 
ано t alternative of cach of the BI items 
puting minim cach of the criterion measures. By 
Y "ae Validity levels (see footnote in 
Gi, “Че ц 3), empirical predictor keys were 
mtia; y P on the BI to predict each of the 
am usns the total sample of 137 into 
bles of 79 and 78 subjects, a double 


ati ras 1 
9n was performed. 


Subs, 
Oss-vani 


Resutrs AND DISCUSSION 


or m 3 give summary statistical 
Pob. samples of scientists. Ter 
in ea "a (reading down the left-hand 
1 the ch table are the criterion meas- 
S and st extreme right are given their 
Tr. Center andard deviations, and in the 
X be p are given their intercorrelations. 
isals oted that all of the performance 
inter 5 4 Ere by supervisors (Variables 
tab] Corre] o? and 17) show relatively v 
Thi 5; indic, ns among themselves 1n both 
я ating the influence of a halo effect. 


m 
lires n ) 


Shi, $ fur [ 
abs Se demonstrated in the relato 
form dnd the Likability criterion (Vari- 
LM avin, the supervisory ratings, yi 
таң Se 8 Significant correlations only 

Ags ү Supervisory ratings. The peer 


Sho З а 
thee” hi Tables 5, 6, 7, 8, and 


Those Cor, СО!Те!аЧопз, the magnitu 
Among 1005 being generally less than 

dee the supervisory ratings in Table 
Ags j Tally: higher than the supervisory 
АДУ : able 3. The “total” or average 
ieni, bles” Deer, and subordinate ratings 
9, 10, 11, and 12) also show 
s intercorrelations in both tables, 
* magnitude of these correlations 
Much less than those for either 


or " 
Т peer ratings taken alone. 


16) also 
de of 


э an, 
tati q 


2 


The intercorrelations of the peer ratings on 
the four basic rating variables (Creativity, 
Skill with People, Quantity of Work, and 
Overall Work Performance) with the super- 
visory ratings on these four variables show 
that there is very little relationship between 
peer ratings and supervisory ratings. Evi- 
dently when a supervisor rates a man on 
Overall Work Performance (for example) he 
is thinking of quite different things than are 
the peers who rate this same man on this 
same variable. In examining the pattern of 
intercorrelations, it would appear that “liking 
a man” plays a major role in a supervisor 
giving an employee a high rating on any 
variable. Likability (Variable 18) is sig- 
nificantly related (rs of 41 to 59) to 
supervisory ratings but not to peer ratings. It 
may be that such things as loyalty, friend- 
ship, being pleasant to work with, doing what 
the boss says, etc. have a significant impact 
on the supervisor and produce a halo жс 
which colors all of his ratings. However, the 
combination of peer, subordinate, and supii 
visory ratings provides a басла mi 
picture which represents more pei eng 
measures of the quantity of work oe € ^ 

ill with people, creativity, and overall wor 
z ither the supervisory Or 
performance Кт eum 

ings tak . н 
der e criterion (Variable 15) куз 
the Number of Salary pol (V pi e 
14) seem to be generally unrelated to any of 
the other criterion measures save each other, 
indicating that length of time оп the job and 
number of monetar 


y increases are not related 
to the various performance criteria for this 


The Psychologist's 


of scientists. | 
вари (Variable 19) shows highest correla- 
ne o tables with Variable 12, 


across the tw 


tions 
т com 


the “total” (о 


Tork Performance. | 
W и іре сепіег section of Table 2 (Vari- 


ables 20 through 38) the empirical keys con- 
structed from Sample 1 are listed. On the 
extreme right are listed the means and stand- 
ard deviations of these keys along with the 
number of items making up each key. The 
correlations listed in this section are the 
result of applying these Sample 1 scoring 
keys back to the BI responses of the same 
sample (Sample 1) and then correlating the 


bined) estimate of Overall 
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east 25% of the s 
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e criterion, 


am correlation of .25 between an item alternative and the aj 


ding and a m 


cted on a 10% and .22 basis. 


ber-of-Salary-Increases key, .43 and .30. The 
first four keys, as indicated, are not based 
on either supervisory ratings alone or peer 
ratings alone but rather on the combined 
supervisory, peer, and, in some cases, sub- 
ordinate ratings. 

Two other variables also held up quite 
well in cross validation. These were Variable 
40, the key predicting the supervisory Skill- 
with-People ratings, and Variable 44, the key 
predicting the peer Skill-with-People ratings. 
Variable 40 cross validated .30 and .29, re- 
spectively, in T: ‘ables 2 and 3, and Variable 44 
cross validated .34 and .23 as presented in 
these two tables. Apparently, Skill with 
People is either an easier attribute to rate or 
people are generally more aware of this 
ability in others than they are of the other 
performances being rated, and therefore the 
supervisors alone and the peers alone pro- 
vided more predictable appraisals of this 
ability than they did with other ratings. 

Tt is important to note that the keys pre- 
dicting the supervisory ratings alone (with 
the exception of Variable 40, the Skill-with- 
People key) did not hold up in cross valida- 
tion. Also, the keys predicting peer ratings 
alone, although showing some predictive mi 
ity (such as Variable 44, the queue p 
key), generally did not hold up too well in 
0 dation. However, when peer and su- 
tings are combined, apparently a 
te estimate of a scientist’s per- 
ded which can be predicted 
m biographical informa- 
tant to observe here 


cross vali 
pervisory ra 
more accura 5 
formance is prov! 
with some success fro 
i is also impor à 
int di pA vm criteria derived from 


ranking procedures (Variables 15 ш a 
were unpredictable. Although е ой 
tributions Were statistically treated according 
to Ghiselli and Brown (1962), perhaps the 
conditions under which they were collected 
( heterogeneity and large discrepancies among 
numbers of subjects across ranking groups, 
etc.) rendered them somewhat inaccurate. 
Several important findings with significant 
cations have emerged from these anal- 
hical characteristics were identi- 
hen incorporated into scoring 
tive of several dimensions 
of pharmaceutical scien- 


impli 
vses. Biograp: 
fied which, w | 
keys, Were predic 
of the performance 
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tists. This was especially true in the predic- 
tion of creativity, where cross validities of 
.36 and .42 were obtained. It has been shown 
that peer and supervisory ratings yield rela- 
tively low intercorrelations with each other 
and that either taken alone does not provide 
as independent or as predictable criterion 
measures as do combined ratings. This find- 
ing is in agreement with and provides some 
support for the findings of Buckner (1959) 
who found that 


ratings of shipboard performance for which inter- 
rater agreement estimates were high, were less 
predictable (from scores on two aptitude tests 
and school achievement) than were ratings for 


which the interrater agreement estimates were 
moderate and low [p. 63]. 


In the present study the interrater agree- 
ments between a scientist’s supervisors and 
his peers were extremely low, although the 
mean rating for a scientist derived from these 
Sources provided quite predictable measures 
of performance. This finding certainly would 
appear to be logical in that no one person 
(or even class of Persons) can observe a 
Scientist employee from all different per- 
Spectives and view all phases of his per- 
formance; whereas several observers (es- 
pecially at differing hierarchical levels) view- 
ing the same person can get, in sum total, 
a better overall view of his capabilities, 

This study also Provides a sobering note 
to investigators in assessment and applied 
Psychology on the need for and importance of 
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or constructed on any research. 
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703 commiss; 

Ses Re oe officers and 594 noncommissioned personnel serving in an 
fulfillment and orce Command completed a questionnaire measuring need 
Were compared satisfaction. Results for 3 levels of the commissioned officers 
The findings Tes previous results for analogous levels of civilian managers. 
satisfied м 5 owed that the military officers were less fulfilled and less 
Чоп increased their civilian counterparts. However, fulfillment and satisfac- 
managers. Wh in relation to military rank in the same way as for civilian 
Officers, шашы officers were compared with noncommissioned 
ower-ranking 4 COs reported more fulfillment but less satisfaction than 

commissioned officers. 


In y 

brise 15 book 
taf Douglas Mer Human Side of Enter- certain characteristics of the environment 
оед Principles one (1960) stated that within which the peacetime military operates 
Meee from ina organization theory are that raise doubts as to whether the amounts 
The Bor Says: Ppropriate models [p. 16]." of need satisfactions in the military would 
Mary venti correspond with those of civilian managers. 
M om - principles w mer Military organizations are confronted with 
it, le Chad of models y^ silla Pu the necessity for a sustained high level of 
ч berg att mo uM Which differ in important preparedness for extreme emergencies (i.e., 
л тата versal ани organizations . . - - combat) in a time of nominal peace. In ad- 
un » it is ЦЕ common to all forms dition, the increasingly shortened reaction 
apparent that they are th nuclear or even limited 


time associated wi 
warfare emphasizes the need for centralized 


the ite ү military [р. 16] 
te itan Prominent А decision making and continuation of a bas- 
ha, ca] Y mode] as attention focused OD ically downward-oriented hierarchical struc- 
ton Seldo, Banization ^ key to understanding ture. At the same time, the sophistication 
logs to M studied theory, psychologists of modern weapons systems and the growing 
$) pari this kind of organiza- complexity of organizational forms have led 
ce of more indirect forms of 


йк ari н 
c Ti Son y = 
om. ће with business firms (Lange, to the emergen 


ing Marja, Pre 

1 aeg Sn i ws study is aimed at such control (Lange, 1965). These disparate re- 
"Sent Satistact area of need fulfillments quirements—coupled with the fact that most 
ч 5а Udies (Py day-to-day military operations are carried out 
ly PtisegDles ofr orter, 1962, 1964) in- in peaceful, nonemergency situations—point 
Ка Dos; espondents from business to the strong possibility of relatively greater 
Ne шен Meis managers at higher- frustration and dissatisfaction on the part 
pter action е. significantly more of military officers compared with business 

Wi jn op, Com ап those at lower levels. managers. 
tag Logg Sänization SONS of military and Few studies have been reported that com- 
NA Would 1. S (Etzioni, 1961; Jano- pare satisfactions of military personnel with 
1 Bers, D Within ead us to expect a similar — those in other kinds of organizations. There 
| ae " These sa the hierarchy of military is some fragmentary evidence, however, in 
non башы me studies, however, note support of our expectations. Fleishman’s 
f big Pai State, sistance provided by personnel (1956) study that compared officers in four 
Prog Sista lar the Ir Force is matti Pünowl- naval organizations with managerial personnel 
m —anks are due E. V. Baravelle jn business organizations found that the 
d that they had to assume 
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ng a data collection and Tom West 
Computation. 
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more responsibility relative to their percep- 
tions of their authority. In another study 
(Bowers, 1962), a comparison of Air Force 
research and development staff personnel with 
staff managers in a civilian research agency 
showed a greater discrepancy in the military 
between ratings of the importance of various 
work factors and ratings of the extent to 
which these factors were actually provided in 
the employment situation. 


In the current study, perceptions of need 
fulfillment and satisfaction with fulfillment 
of commissioned officers from an Air Force 
Command were compared with those of 
analogous levels of managers in civilian 
industries as reported previously by Porter 
(1962, 1964). In addition, similar attitude 
data obtained from noncommissioned officers 
were compared with those of the commis- 
sioned officers. 


METHOD 
Questionnaire 


The data for this study were collected by means 
of the same questionnaire, slightly modified for 
applicability {о military respondents, which was 
Previously used in studies of managers in business 
firms (Porter, 1961, 1962). The results reported here 
are based on answers to parts of 13 items con- 
tained in the questionnaire (which has been de- 
scribed in detail in the previous articles). These 
items are relevant to а Maslow-type classification 
of needs according to their Prepotency and thus 
tap the following five types of needs: security, 
social, esteem, autonomy, and self-actualization. For 
each of 13 specific items (eg. “the fecling of self- 
esteem”) the respondent was asked to indicate, on 
a 1-7 rating scale: (а) How much is there now? 
(b) How much should there be? and (c) How 
important is this to me? 


Procedure and Sample 


Was sent to approximately 800 
and 700 noncommissioned 
Air Force overseas Com- 


and 
supervisory- 
. The questionnaire was 
central personnel offices 


officers 
type positions were included 
distributed through the 


? The command consisted of an area headquarters 
and a number of geographically dispersed air bases 
Which were charged with operational flying апа a 
wide variety of logistical activities, 
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servicing the various bases and headquarter a 
and the anonymity of individual respon od Í 
guaranteed. Usable responses were т. 
1,297 individuals or about 85% of the = 
both commissioned and noncommissioned га i 

From personal data questions asked on ible 
page of the questionnaire, it т depen 
classify respondents on a number of study 
variables. The relevant variable d об 
military grade, since, among Sams е алай 
grade correlates highly with devel n 
responsibility, and among noncommiss super” 
it is the principal determinant of the 
hierarchy. 


RESULTS gi 
j 
Comparisons between. Military and 

Respondents 


з OD 
In this part of the Results pb 
parisons will be made between т in 
of the commissioned officers samp 
present study and three analogon ness d 
managers and executives from a with ki 
industrial firms sampled pues ‚1%, 
the same questionnaire (Porter, 1 i le 
In selecting the appropriate шар jon „| 
from the managerial sample, atte wy 
given to relative responsibility the yi 
money, and material, in addition tO follo% ү 
criterion of hierarchical level. be j 
pairings were selected as the most ¢ 
ones: 


Brigadier generals and 
colonels 

Lieutenant colonels and 
majors ........ Upper-! 

Captains and 
lieutenants 


an 
niddle ™ 


‚.. Lower-middle ' mi 
eed MI 
Table 1 presents the results ae? н Г 
ment. The larger an entry in а Pa fot y 
the table, the greater the fulfilln | ye? 
need category for a given grouP КИ 
ents. те V ae 
It is clear from Table 1 that le у 
levels of the military perceive’ anaf y | 
fulfillment than equivalent-level ! ШҮ 
business firms. Signed-rank tests ° inks "y 
of mean values between pairs of nf | 
13 individual questionnaire male ety! 
that upper-middle and lower-mi е ШЕ il 
managers report significantly -— y © 
(P < .02) than the compara | 
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“nel Major breviations:; салар | | | 4.90 
oun; Cpt/Lt. zi Col. = Brigadier: General/ Colonel group; V.Pres. = Vice-President; L/C/Maj. = Lieutenant/ 
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-presidents also re- 
А randi than generals and 
a dig Ak test on are not significant by 
Officers ji Only in the social need 
Were Magers д ndicate greater fulfillment 
чуо Clear a all three levels. There 
‘thong the ifferences between the two 
th » Pattern of relative fulfillment 
pe of needs. 
lon E UN results for mean dis- 
S in ied other words, mean 
ln ш fulfillment. The degree 
à Tswer to 5 obtained by subtract- 
necte nuch of th part a of each item 
With yoy e characteristic is ow 
item Ta assignment?” ) from part 
You think Ow much of the character- 
tenen ee be connected with 
Ne in ж, ). , Thus, the larger the 
isfaction | in Table 2, the greater 


T 


ist 


ent d 
and sou 
Significant differences (7 


«.01 by signed-rank tests across 13 in- 
dividual items) are apparent in the direction 
of greater dissatisfaction among the military 
officers than civilian managers of equivalent 

olds up strongly for 


rank. This conclusion h 
each of the three comparison pairs of levels, 
with the most marked differences occurring 
in the esteem and security need categories. 
In terms of ranges in mean dissatisfaction 
(for the total of all 13 items) from the 
highest to the lowest ranks in each sample, 
Table 2 shows that the range for the military 
(.85-1.21) is about one-third larger than 
that for the civilian managers (.56—.81). This 
indicates that the influence of military rank 
on need satisfaction may be somewhat greater 
than the effect of echelon level in civilian 


business organizations. 
When relative differen 
types of needs, in terms О 
ascertained from Table 2, it 
both managers and military 


ces among the five 
f dissatisfaction, are 
can be seen that 
officers indicate 


M, 
ко TABLE 2 
= SATISE 
Neeg ie "ACTION ron Баси Neen CATEGORY: Атк FORCE OFFICERS VERSUS CiviLIAN. MANAGERS 
с = eS 
e ——À— —— 
Ste y B.G/c { J iddl Cpt/Lt. Low iddl 
К, цу; :G./Col. /. Pres. L/C / Maj. Upper mide е р . ower middle 
à M (№ = 22) @ Те Д AT ( = 659) (N = 464) (N = 431) 
s ИНЕ у А 
що 0.55 045 114 041 1.10 0.38 
0.32 0.30 0.61 0.34 0.58 0.33 
lij. 1.04 0.45 1-15 0.66 {27 0.71 
Aion 0.90 0.55 1.26 0.87 1.25 0.96 
1.04 0.90 1.45 1.12 | 1.53 1.17 
| 85 56 1.17 70 1.21 St 
~~ a == = 


геу > 
iati — 
ions see Note of Table 1. 


142 


that the most dissatisfied are the self-actual- 
ization needs. However, the two samples differ 
in terms of next-most-dissatisfied need. For 
the managers it is autonomy, while for the 
officers it is the esteem need area. Security 
and social needs are the best satisfied for both 
samples. 


Comparisons within the Military Hierarchy 


Table 3 presents the results for need ful- 
fillment for the three officer groups and for 
the three noncommissioned groups. The table 
shows a clear trend (significant across the 
13 individual questionnaire items at the .01 
level by the signed-rank test) within the 
commissioned officers for each higher grade 
to report more fulfillment. That is, brigadier 
generals and colonels consistently perceived 
more need fulfillment in their positions than 
did lieutenant colonels and majors, who in 
turn perceived more than captains and lieu- 
tenants. The overall trend within the non- 
commissioned category is not as clear-cut, 
Since there is relatively little difference in 
fulfillment between the high-ranking chief 
master sergeant/senior master sergeant (CMS/ 
SMS) group, and the middle-ranking master 
sergeant/technical sergeant (MS/TS) group. 
The latter group does, however, report sig- 
nificantly greater fulfillment than the lowest 
noncommissioned level in the sample, staff 
sergeants. 

The most interesting result shown in Table 
3 is the finding that chief and senior master 
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tains and lieutenants. In fact, the top 
commissioned grades (CMS/SMS) Tt 
about as much fulfillment as the a 
colonels and majors! Even the midd NS 
of noncommissioned officers ie " 
group) reported somewhat more ПС 
than captains and lieutenants. A M 
means that there was not a steady n d 
perceived need fulfillment from. € 
noncommissioned ranks to the hig 1 
missioned officer levels. The X 
continuous, with a sharp drop ee " 
highest noncommissioned level anc ; whe 
officer level. The question then arise 
this same break appears with regar m ssh 
well the various military levels are 
with the fulfillment they receive. пе? 
Table 4 presents the results for, cal 
satisfaction. These show а signi”. 
crease in dissatisfaction from ae 
general/colonel group to the lieu ie 
onel/major group, but virtually tains 
from the latter to the level of r A 
lieutenants. Within the gon g di 
officers, there are strong trends ^. "E 
faction to increase from the hig А 
lower grades. gis 
Comparing officers with парео reel 
officers in Table 4 shows that eg m 
(CMS/SMS) reported generally з пй ^: 
more dissatisfaction than dap А 
tenants even though (as was seen reat ү, 
they had reported significantly р опсо? j 
fillment. Also, the intermediate tec 


j 
sergeants reported consistently (and sig- sioned grades, the master EY е!" 
nificantly) greater fulfillment than the lowest sergeants, who likewise reporte ш{епал” 
grouping of commissioned officers, the cap- ment than the captains and lie { 
Éi 
TABLE 3 Р grit 
Mean FULFILLMENT FOR EACH NEED CATEGORY: Ата Force OFFICERS AND NoNCOMMISSIONE! j ї 
6 j 
ч 2 
Need category | B.G/Co. | L/C/Maj | срелл, | смѕ/ѕмѕ | м/т a) | E 
(NW = 22) | (N 2217) | (N= 461) (N= 79) | (N = 302) M 
Security 5.77 4.85 4.75 522 185 i 
Social 5.64 5.33 521 5.60 5.70 rey 
Esteem 5.26 490 452 492 4.84 n 
Autonomy 5.39 4.74 448 4.83 4.78 i 
Self-actualization 5.30 481 4.58 4.86 4.86 n 
М of 13 items 5.4 4.89 4.64 5.00 4.96 "d 


Note.—For abbreviations see Note of Table 1 
Master Sergeant group; MS/TS = M: 


ser! 
* ter 
//Raditional abbreviations are: CMS/SMS = Chief Mas 

aster Sergeant/Technica] Sergeant group; 


S/S = Staff Sergeant group- 
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OF TABLE 4 
ATISFA "d Б 7 
ACTION FOR EACH NEED CATEGORY: AIR FORCE OFFICERS AND NONCOMMISSIO О: 
É B ANON SIONED OFFICERS 
Need са | 
tegory B. j 
egory ee L/C/Maj. Cpt/Lt. CMS/SMS MS/TS s/s 
бошду (Nez) | 0460) | =) | w-3m | Qr» 2 
ocial 0.55 1.14 
: ч 1.10 1.20 1 
Esteem 032 0.61 0.58 0.56 097 Y 
олоту 04 1.15 127 1.36 145 s 
Mactustization 059 1.26 1.25 1.35 146 a" 
ind ] 145 1.53 1.54 1.63 17 
з, 74 
85 1.17 1.21 1.26 1.37 1.49 


Note, 
For al 1 
bbreviations see Notes of Tables 1 and 3. 


out 
li as mu 
ie nt Eu Ийе; M majors and Janowitz, 1959) cited earlier. Consequently, 
— than these aa distinctly. more dis- the safest generalization at the present time 
indi E hus, Hie E oer and middle-officer is that although military officers report gen- 
Missi te that alth ndings shown in Table 4 erally more dissatisfaction than civilian man- 
ment officers m high-level noncom- agers, they are not at a particular disad- 
lat nitie elt they were obtaining vantage in higher-order need areas. 
they commission це fulfillment than low- Second, the hierarchy of commissioned- 
ed officers, at the same time officer positions in a military organization 
the same relationship to percep- 


Comp Dected 

dis "hissioned m more fulfillment than the has roughly 

This Isfaction Mi and hence had greater tions of need 
ith their level of fulfillment. hierarchies of 


Est as 

ее especi А z A a 

m ally true in the security, organizations. 
in business and 


fulfillment and satisfaction as 
managerial positions in business 


This was shown by the fact 
industrial firms 


jp ^n 

m рана а need areas. that, as 
Um 9f needs ns are made among the five (Porter, 1962, 1964), fulfillment and satisfac- 
Missin е а. terms of relative deficiencies, ton increased with increasing rank. More 
teng oneg a from Table 4 that both com- specifically, both samples showed relatively 
% М nd noncommissioned officers small increases between the lower-middle 
(i.e. captains/lieutenants in the military 
er-middle (i.e., lieu- 


я 9 re 
di ue Sie ay the self-actualization needs 
Кш iera a ied. The second most hierarchy) and the upp! | 
“ч Ut for S for the officers were esteem tenant colonels/majors) levels, and relatively 
ty Need the enlisted men it was the large increases between the upper-middle and 
t vice-president (brigadier general/colonel) 
Jevels. Thus, there was à remarkable similarity 


area 
Em D , " 
of ISCUSSION in the findings as related to differences be- 


© Co 

Da, mg; Прагі j Is. 

a sion isons between the three ranks tween adjacent levels. — , . 
One of the most intriguing findings emerg- 


Officers com- 
and the three ing from the study was the fact that for 


9p, е 
$ Vels 
bi Cem а ОЁ manage E 
rs ] conclu í tli 
ч t, пратен; gers, severa perceptions of fulfillment in the military 
агу officers tend to be much sample there were clearly two sets of hierar- 
chical relationships, one for the commissioned 


isga ts 
lan Ssatigg, 
< and another for the noncommissioned. 


ed ] 
fie; thou anagerial t each rank than their 
t counterparts. This fnd- n | s 
W pat the Уу not be as "important as the Since the higher-ranking noncommissioned 
Hg, ups, ATBest differences between the men consistently reported more fulfillment 
than the lower-level officers, it appears that 


4 omy Wi 
) еге ‹ 
чї Y a not concentrated 1n the 
че а Self-actualization categories; each category of respondents (enlisted men 
t oe predicted on the basis and officers) used its own group as a fame 
ical studies (Etzioni, 19615 of reference in responding to the question- 
; 


officer 
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naire. That is, apparently the high-ranking 
noncoms, the technical sergeants and above, 
were responding in terms of the fulfillment 
they were receiving in their positions or 
roles as the top-level personnel in a hierarchy 
going from private to chief master sergeant. 
'The lieutenants and captains, on the other 
hand, apparently were responding to their 
roles not as individuals higher in rank than 
top-level noncoms, but rather as individuals 
lower in rank than other commissioned 
officers. This interpretation is reinforced by 
the fact that not only did the top non- 
commissioned officers report more fulfillment 
than the lower commissioned officers, but 
they also expected more fulfillment. (This 
was indicated by the fact that their perceived 
deficiencies іп fulfillment—“expectations” 
minus “reality’—were larger than the de- 
ficiencies for officers even though their re- 
ported fulfillment was greater.) The question 
then arises as to whether similar findings 
would be obtained in business organizations 
if the need perceptions of lead men or quarter 
men were measured by the same scales as 
those used with managers. Would the highest- 
level workers report greater need fulfillment 
than the lowest-level managers? The available 
evidence (see Porter & Lawler, 1965) in- 
dicates they might not, but there has as yet 
been no direct test of this question. 
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zm tracking performance was 
бош back. Each of 60 Ss was t 
ability булыр. their team 
à tque S's feedback represe 
Ойы ‚ moderate, 
Е varying ability. Ss 
nder the stringent criterion. 


blamed their 


by criteri ng 
criterion difficulty, but poor trackers рег 
{ the stringent СГ 


criteri У 
on. The inhibitory influence 0 


duri s 
during a terminal extinction se 


15 an im > 
tasks. nportant determinant of per 


bach, m 
ата 
"ecen : 
lion 


Der 
au 
of : OMA гав 1963; Hall, 1957; Коѕеп- 
"ere 1а eedback 1962). An inherent aspect 
ampe tS individ is that it typically mis- 
ual performance. As an €x- 


tha, 2 SU 
at "Dpose th; 
А is that A and B are teammates, 


а go 
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ае рт and A performer and B a poor 
Мац ч йна they receive social feed- 
S cons 9 some Sents their team performance 
"a ered Re ZUM Team performance 
p trib Possibly to be some function of the 
tiorma ONS, TI weighted) of the individual 
е is Pu criterion to which team 

an ompared might be the per- 
ance E individual or team, 
ls oF И. a rival team, perfect ре!" 
e ator н standard established 
i. team ow, close scrutiny of this 
av À'$ goo aee mind reveals that, 
Wo А d performance makes the 
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te 8 Seq Se у 
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performance 
nted his individual performance relative to 


or stringent criterion. 
contrived partner 


Performance of good 


ssion. The results suggest 
formance in team ап 


e University 


examined under conditions of simulated 
old he had a partner and that posttrial 
relative to average tracking 


These criteria simulated partners 
s for poor scores received 
trackers was not affected 
formed best under the moderate 
iterion was magnified 
that criterion difficulty 
d perhaps individual 


more lenient from B’s point of view, 
formance makes the criterion 
for A. That is, in comparison 

feedback of individual per- 
formance, A has to perform better to obtain 
feedback of good, but B can perform worse. 
In short, social feedback underestimates A’s 
individual performance, but overestimates Вз 


performance. 


The primary 
was to determine if individual performance is 


affected by criterion difficulty. The major 
thesis is, of course, that social feedback can 
affect individual performance by controlling 
criterion difficulty. To the extent that the 
thesis is supported, individual performance 
under conditions of social feedback should 
derstood. However, social feed- 
he only determinant of criterion 
tor may simply employ 
criterion than an- 


criterion 
but B's poor pe 
more stringent 
with evaluative 


purpose of the present study 


back 
difficulty: 
a more strin; 


on another task. Furthermore, 
culty is closely related to level 
which variable has received 
perimental and theoretical in- 
1966; McClelland, Atkinson, 


achieve than 
criterion diffi 
of aspiration, 
considerable ех 
terest (Locke; 
Clark, & Lowell, 1953). 

A subsidiary purpose of the present. study 


was to ascertain апу effect that social feed- 
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Meter 


Fic. 1. Reproduction of a tracking display. 


back might have on an individual's evaluation 
of his performance. Since individual con- 
tributions are difficult or impossible to dis- 
entangle from social feedback, A (of the 
hypothetical team) may form the impression 
that he performs worse than he really does, 
and B may be misled into believing that he 
performs better than he really does, Thus, 
social feedback may not only affect per- 
formance itself, but may affect self-evalua- 
tions of performance as well. 

In this experiment, individual performance 
of a Compensatory tracking task was ex- 
amined under conditions of simulated social 
feedback. In actuality, each S performed 
alone and was individually evaluated relative 
to a criterion purported to represent average 
tracking ability, However, each subject (S) 
was told that he had a partner, and that his 
feedback represented the performance of his 
team relative to average tracking ability. 
Furthermore, criterion difficulty was varied 
experimentally at three levels (lenient, mod- 
derate, and stringent), Thus, it was as ifs 
had a good partner under the lenient cri- 
terion, an average partner under the moderate 


criterion, and a Poor partner under the 
Stringent criterion, 


METHOD 
Subjects and Apparatus 


The Ss were 60 male undergraduates, each of 
whom served five consecutive sessions and was 
paid $6.25 for his service. All Ss were naive to 
experimental tracking tasks. 

The apparatus was a specially constructed, com- 
pensatory tracking device which is described 


in 
detail in another report (Gain & Fitts, 


1959). The 
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Figure 1. Te 


tracking unit is diagrammed in 
tracking display was a лаш. Pi 
taining a zero-centered scale with a ld be 51 
on either side of zero. Ап indicator cou determin 
sweep across the scale according to a ре generi 
wave pattern. The wave pattern was Sj 
from two low-frequency (1 cycle is NS. 
sinusoids, and S's task was to manipu jm steadi 
trol knob in an attempt to hold the indica 
at zero. ТИ меи 
The performance measure was th as scored 
absolute value of tracking error which ds 8 el 
automatically over the final 55 eae terms ^ 
60-second trial. The original scale was ch trial V 
arbitrary voltage units. The score for жЕ” а 80 
later transformed from voltage units ү) ansfo, 
of linear extent (millimeter units). The ен erit 
metric will henceforth be referred to бї 


eviati " 
error and represents the pum и 5% те 
millimeters which would be obtaine scale 


amplitude distribution were drawn to the 4 
the tracking display. ihe г, 

A feedback meter was mounted on xis ШК 
unit and was identical to the trac pen bid. 
except that the area to the left of zero gy, rity 
red and designated poor, and the area nate pu 
of zero was shaded green and ue e pelo", 
The poor range was purported to ISP тер! ut 
average scores, and the good ТАЙКЕ qd com 
above-average tracking performance. jn seP 
tracking units were used and were houst ions). 
sound-treated booths (tracking-unit St? 
experimenter (E) controlled and uem 
ing task from still another room. шр 
munication from E to each S was ut 
way speaker systems in which channel 
determined by E. 


ndent 


ectio 


: ! 
Design and Procedure А 


un 

For experimental expediency, 5s were ation ui 
а time, one S in each tracking-unit secon y 
session was composed of twenty 60-8 rind ret 
The intertrial interval was 30 seconds, 
time E recorded S's score and admi atically si! 
back. A green light on S's unit он the 
on at the start of a trial and of ай " 
termination. A verbal ready signal xd кщ 
mediately prior to the start of a trial. NES") 

Individual feedback of the raw er? ymin 
original voltage units) was verbally Sessio п | 
оп the first two (practice) sessions. Sei 
constituted the experimental Sesion. а ай 
each S was assigned to one of t or SUP i 
difficulty conditions: lenient, moderato picti 
Assignments were random with the p со 
there Бе an equal number of $5 P as on 
АП Ss received social feedback instruc т of 
3. There follows a descriptive Рот 
instructions: tp 


л oft 
M 


he 


ber 0 


Р t 
Today you will become а memi aver 


man team, and your scores will be 


er f 


p——————————————— Á 
> OE gat di ey 
Кы“. 
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those ca 
trials, АКАУ your teammate on correspondin 
pleted the ex ve oe partner has Пу SE 
record of ores and we are simply using the 
averaged E scores. Nevertheless, your score 
leam score Шр тау һе considered a tru 
you do as ыш reflects how well the ies di 
Score will be team. After each trial your team 
norm, The so ы ыа and then compared to a 
(уставе Subject. is simply the score earned by the 
ice, Thus, ү after the same amount of prac 
Performs sd will be told how well your pes 
ef is comparison to the average individual tracker. 
ch е feedback will be accomplished by means 
nit. The zero meter mounted on your tracking 
Ck meter ss Doint at the center of your feed- 
presents the norm, that is, average 


track; 
Ing abili 
Zéro 4 bility. Th 
ч М? е 1 H 
it dicat bei Breen region to the right of 
r-than-average scores, while 


regi 
aver. gion to 
mane Ёегїбү the left of zero represents below- 
nade clear hep . Now, it should be 
own individu, team score may misrepresent 
g tenn performance. Conceivably, 
ai tka than average as an individual 
than "Average ma score in the red owing to a 
lieca e trage but Hner; or уан. muy he: wor 
Se of an aaa a team score in the green 
e-average partner. 


U t 
e d mates 
were informed that they were 


$$ т 
m ates, x 
Droxi back Eae feedback was presented on 
3 ately 15 er for a 5-second duration ap- 


, and 355 
we Ps А Pu aifer cach trial on Sessions 
(qs amined ; evels of criterion difficulty 
Wol lected on rom a distribution of error 
Кы dist) The first Sessions 3-5 of a pilot study 
Moderate Dution S second, and third quartiles of 
ааа 5 апд odas selected as the stringent, 
a Dare intend Ө criteria, respectively. These 
te Oye hers, In m to simulate poor, average, and 
sq Clive] the Ее of the arbitrary voltage scale 
D» Werl an og values were 35, 50, and 65, 
tej Pack Te 2.56 25 corresponding average error 
I tive 4,735 23:65; and 475 millimeters. Social 
aye eyo сп expression of 55 error Sco? 
Ay pont that en in original voltage units. 
i 5 score was more than 50 units 


15 criteri А 
erion, his feedback needle would 
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point to the appropriate extre 

e n € value кеа ое 

coat on Sesion 5 (extinction), but S Б 

тшше o estimate his own individual scor in 
ack meter units) immediately after each an 


RESULTS 


An analysis of variance of i ; 
average error scores aed far се 
tracking-unit stations, F(1/54) < 1.00 either 
(which were not differentiated теш dis 
until Session 3), F (2/54) < 1.00 iti 
interaction of these variables, F(2/54) 1 з 
were statistically significant (№ > .05) These 
results justified the pooling of the data Mosel 
from the two tracking-unit stations for all 
subsequent analyses, and warrant the con- 
clusion that the groups were equivalent prior 
to the introduction of experimental conditions. 

In order to determine if effects of criterion 
difficulty on tracking performance depend on 
tracking ability, the 20 Ss of each group were 
rank-ordered in terms of their median average 
error on Session 2. Then the eight best and 
eight worst trackers per group were designated 
good and poor trackers, respectively. Data of 
the middle four trackers of each group were 
omitted from subsequent analyses in order 
to maximize the separation of the two ability 
levels. This procedure yielded a 2 (Tracking 
Ability) X 3 (Criterion Difficulty) factorial 


design with eight Ss per cell. 
Evidence on the absolute difficulty of the 


three criteria is presented in Table 1. Due 
to an unfortunate lack of generality from 
pilot to experimental data, it is clear that all 
three criteria were more difficult than was 
intended. Thus, only the good trackers under 
the lenient condition tended to receive feed- 


A FUNCTION OF ABILITY LEVEL 


AND CRITERION pirricurTY 
Trag 
а Session 3 Session 4 
^ Lenient Moderate Stringent Lenient Moderate Stringent 
N +4.5 —18.5 —28.5 +18.5 —12.5 —14.0 
“чш, —36.5 —42.0 730 | 725 —26.0 65 
Anj ach | 
Rega tiger’ i i i ight S: i T 
ive 518 th i 1 of 160 scores derived from the eight Ss (20 trials each) per cond 
ve signs He donne АР ofthe Plow criterion, respectively. condition. 
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о Lenient 
в Moderate 
^ Stringent 


Е 
Е 
S 
5 
a 
Do С ae 8 
© 
> 
ч 
| "P 
———L 1 l1 N) 
9 2 4 6 ё 
Session 3 Trial Blocks Session 4 Trial Blocks 
Fic. 2. Intra- 


back scores in the good range, and, in fact, the 
poor trackers under the stringent criterion 
tended to receive all off-meter scores in the 
poor range. Thus, the three criteria were 
all stringent in an absolute sense, and were 
lenient, moderate, and stringent relative to 
one another only, 

In order to eliminate “warm-up” effects, 
average error data for the first two trials of 
each session were omitted. The remaining 18 
trials per session were organized into six 
three-trial blocks, and the simple median 
score of each trial block for each S was sub- 
tracted from his Session 2 median average 
error to yield an improvement Score. This 
procedure eliminated the contaminating in- 
fluence of extremely poor scores Which oc- 
casionally arose when S explored a new track- 
ing method or tested the scoring system by 
not tracking. Within- and between-session 
trends in amount of improvement as a func- 
tion of ability level and criterion difficulty are 
portrayed in Figure 2. An analysis of variance 
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Good Trackers 


т TS a А ding ability 
and intersession Improvement in average error as a. function of tracking 
and criterion difficulty. 


4 6 2 4 T 
Session 5 Trial Bloc 


at l 
of these data revealed that the aA pial 
improvement was directly related Ай A 
blocks, F(5/210) = 6.71, p < .001, and i 
sions, F (2/84) = 69.33, р virg LA 
versely related to tracking ability, Jearni* 
= 7.05, p « .05. The first two 17216 reflec? 
effects and the latter effect simply i 
that poor trackers had more room тро", 
provement than had good aches. E ý 
criterion difficulty was not signita in ) 
main effect (.05 < p < .10), it di a 
significantly with tracking ability, E 
= 3.88, р < .05. Duncan’s test f imp?" 
1963) showed that the amount o level, qt 
ment was equal under the three ker р" 
criterion difficulty for the good trac jon t af 
was greater under the moderate er ell ^ 
under the lenient and stringent © affer 
the poor trackers (р < .05). The 2 nC 
in the performance of poor GRE gf 
moderate and lenient criteria is hat 
remarkable in view of the fact sur 
criteria differed only slightly in ter! 


INDIVIDUAL ZIN 
AL TRACKING PERFORMANCE 1 
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| TABLE 2 
= BSOLUTE AND RE "E > 
i E AND RELATIVE SE VALUATIONS OF PERFORMANCE ON SE 
E MANCE ON SESSION 5 
Trackj | m on paa 
abilite | Absolute evaluations | Relativ: luati m 
\ { T | ative evaluations 
T—— | Lenient | | i NE 3 
^s HE Moderate | Stringent | Lenient | Moderate | 9? 
Poor —342 | dads | 6.30 | Stringent 
E ES — 0.9! == 33 
Rm Es TA 2089 11.22 +1.33 EN. 
= A | —2179 —1.92 +6 К ал 
I We, зна | +604 | +1416 
н ss meanevaluation score (У = 8). The derivation is explained in the text | кее 
ute 1 Е 
Th evel f à 
m of diff 
cant the эб ( see Table 1). These facts suggest that criterion difficul 
оп Difficulty racking Ability X affects S’s appraisal of his partner's rm у 
only ap- ance. Suppose, for example, that e Ps 
s 


84) CC the interaction 
“ы 17, era e significance, Е (4/ 
ij Uated the important е test (фр < 01) 
enti ed in Figu aportant extinction effect 
terja CHects of t ге 2.2 Specifically, differ- 
E pe E lenient and stringent cri- 
ened during rlormance of poor trackers 
during 9 the Pu only. The differ- 
Extinction pss groups of poor trackers 
(оттар ects peri agus that criterion diffi- 
Mean” b g and not merely per- 
Dere &05 
Perfor, Sra self-evaluations of Session 
si es presented in the left half 
hiding Ply the solute self-evaluation score 
: m of S's estimates of his 
у scores, An analysis of 
/42) | data exposed tracking 
а ant ES 4.71, р < .05, аѕ Ше 
ig бан Sets tented of variance. Thus, 
"S than ded to give higher self- 
y fe. trackers. However, it 
Trackers even the self-evaluations 
Wu fe May st were low in an absolute 
i. Mdb eb fronin the fart that their 
IS ine were also low (see 
s ck di erefore clear evidence that 
із also storted absolute self-evalua- 
Conditiona worthy that the three 
able | yielded different feedback 
uations, but statistically equiva- 
TA boo, and that self-evaluations 
"ésboni trackers) tended to sur- 
ing social feedback scores: 
rred to 


ate for 
being 


oe 
Boog Signi 3 


1 
Of signi А 
ed hat 16.05 ice was ргеѓе 
. 8 Onsigni in order to compens: 
Enificant interaction was 


receive social feedback of —40 and —20 
respectively, but that each estimates his i i 
dividual score to be —20. It follows that ils 
two Ss estimate their partners' scores to bs 
—60 and —20, respectively. Thus, the dif- 
ference between an S’s social feedback score 
and his absolute self-evaluation score is an 
index of his relative (to partner) self-evalua- 
tion. 

Mean relative self-evaluations of Session 5 
performance appear in the right half of Table 
2, Since social feedback was not given on 
Session 5, a relative self-evaluation score was 
derived by comparing S’s mean absolute self- 
evaluation to the mean feedback score he 


would have received had social feedback been 
administered. A positive score indicates that 
$ felt he did better relative to his criterion 
than his social feedback would have in- 


dicated, that is, that he felt superior to his 
partner. Conversely, à negative relative self- 
evaluation indicates that S felt inferior to his 
artner. Tracking ability, F (1/42)= 10.52, 
< 01, criterion difficulty, F(2/42)= 15.92, 
p < .001, and the interaction thereof, F (2/ 
42) = 341, < .05, all attained significance 
a analysis of variance performed on 
aluation scores. As is apparent 
relative self-evaluations were 
r than for good trackers and 
were directly related to criterion difficulty. 
The interaction reflects a magnification of the 
tracking ability effect under the lenient cri- 
terion. These data indicate that S tends to 
scores as accurate reflections of 
ormance, but tends to attribute 
cores to his partner. 


higher for poo 


accept good 
his own perfi 
the blame for poor 5 
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DiscussioN 


The data support the proposition that 
performance in a cooperative arrangement is 
affected by criterion difficulty. Individual per- 
formance of poor trackers was found to vary 
reliably with the ability level oi the con- 
trived partner, that is, with criterion dif- 
ficulty. This effect is undoubtedly ubiquitous 
since social feedback, in obvious or subtle 
form, characterizes a wide spectrum of inter- 
personal settings ranging from the formal 
team to such loosely knit organizations as 
scientific or professional associations. Of 
course an invariant partner was simulated in 
the present study, and the observed per- 
formance effect of criterion difficulty may 
be altered if a more realistic partner is 
simulated by a variable level OÍ criterion 
difficulty. Nonetheless, responses to a post- 
experimental questionnaire indicated that all 
but one of the Ss believed that the feedback 
meter registered genuine team Scores. Thus, 
the social instructions were sufficiently de- 
ceptive. 

The data also Suggest that one's evaluation 
of his contribution to team output is affected 
by the ability of his teammates. Specifically, 
S tended to accept the credit for good team 
Scores but not the blame for poor team scores, 
Hence, criterion difficulty should be con- 
sidered in any variable analysis of the forma- 
tion of attitudes toward group members (Lott 
& Lott, 1960). Indeed, self-evaluations may 
play a mediating role in the performance 
effect of criterion difficulty. When team per- 
formance is good, each member shares the 
credit with his teammates, group morale is 
likely to be high, and individual effort should 
be maintained. However, when team per- 
formance is poor, each member attributes the 
blame to his Partners, group morale is likely 
to be low, and individual effort may decline, 

However, it is important to note that self- 
evaluation and average error scores did not 
completely covary in the present study. Thus, 
the effect of social feedback cannot be ex. 
plained solely in terms of control of “social 
cognitions" by criterion difficulty. This im. 
plies that criterion difficulty may affect per- 
formance under asocial as well as social con- 
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ditions. That is, criterion difüculty may 
influence individual performance even when 
S does not have a partner to whom he E. 
attribute the blame for poor scores, or Wil 
whom he can share the credit for good scores. 
In general, the present data imply that it 
Possible to maximize the performance a 
Possibly the morale) of a team by appr 
ate manipulation of its member am 
Furthermore, if criterion-difficulty effects E 
not restricted to social conditions, then б. 
terion difficulty may influence behavior К 
any situation іп which individual раното 
ance is evaluated relative to a aus. 
The performance of an industrial or milita 
worker may therefore be affected by da 
evaluative strictness of his supervisor, ап e. 
Supervisor may be able to maximize the р 
formance of his men by optimizing 
Stringency of his standards of age сї 
Unfortunately, the optimal level P the 
terion difficulty cannot be specified unti H 
more lenient end of the continuum 0 
terion difficulty is examined. Howeveb 
apparent inhibitory effect of the string n 
criterion at least casts doubt on the nei 
that the higher one’s goals (criteria) pur 
the better he performs (Locke, 1966). ma 
thermore, the data provide tentative in “hi h 
tion concerning the boundaries within n |, 
the effect of criterion difficulty is s n on 
Specifically, it appears that the effect most 
learning as well as performance and Й рё“ 
likely to occur with relatively unskilled 5, 
formers. Finally, the sheer demonstratio? , y 
a criterion-difficulty effect exists is iMP onal 
in view of the fact that the informs, io? 
value of feedback is independent of CP" оре 
difficulty. Hence, the present findings i ex 
tribute to a data base from which ено?" 
Planation and full appraisal of cri rope" 
difficulty effects may eventually be deve 
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1. H . "S H H d 
A comparison of attitude survey responses between identified and иин? 
manufacturing employees was made under 2 conditions of identification. 


involved a face-to-face designation by 
group he was to be in (high threat), 
location as the respondee entered the te: 


assured. confidentiality 
were assured anonymity. 
both identified condition 
over, the items themselves 


produced у; 


the respondee's manager as to which 


and the other involved a random al- 


sting room (low threat). All Ss were 


of their responses, and the nonidentified Penis 
A positive distortion in responses took place une 
but significantly more under high threat. Моге- 
ariable distortion. Items dealing with 


> t: 5 е itive dis- 
salary and with ratings of top management produced consistent Ded es 
tortions, whereas items dealing with work pressure and 55 manager produ 
little or no distortion even under conditions of high threat. 


One of the major problems faced by be- 
havioral scientists whose principal research 
method involves attitude Survey work is to 
determine cause and effect. Because the 
"causal? variables are measured in the same 
instrument as the dependent variables the 
two classes are obviously not independent 
from each other and are consequently sus- 
ceptible to a systematic bias. Moreover, rela- 
tionships that occur among the variables may 
be due to causal factors or to conceptual simi- 
larity, and, while assumptions can be made 
as to which is which, these assumptions can 
rarely be pinned down with a high degree of 
certainty. Finally, there is always the dilemma 
of determining antecedents and consequences. 

These problems have received the attention 
of a number of methodologists who have 
Suggested ways of dealing with them (Blalock, 
1961; Hyman, 1955). One of the ways that 
has been used is to identify the subjects (Ss) 
and then tie up certain demographic vari- 
ables to attitudinal responses both at one 
point in time and longitudinally, In this way 
independent and antecedent variables are 
identified and a limited spectrum of causality 
can be determined. However, this method 
introduces a new variable; namely the fact of 
having been identified. The effects of identi- 
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y aire ite 
fication on responses to questionn? еў. 
constitute the major focus of this oe wil 

Specifically, the issues that Bre Я рї, 
include: (а) whether Ss will inde п 
differently when their names € 
answer sheet than when they are P ditio? d 
(b) if so, whether different FE 
identification can lead to differen o a 
“faking”; and (c) whether sry » a 
tendency to try and supply "rig гїаїй Ont 
will do so on all items or just CO hal 

Much of the experimental NOT serso f 
been done on “faking” concerns p" 
inventories, such as the MMPI, at I9 at | 
directly only with Problem (a)— aped 
and do Ss “fake” successfully in Р! ел jf 
pencil tests? Within this body và imi ut 
there is a lack of complete 40 Р 
answering the question. Sheldon ( whet ot 
out that studies concerned with " 
not an individual can successu" 
his score favorably have been соп none 
use of different items and mm. jn 
rable $ populations, and different d 50) E 
conditions. Moreover, Callis а the кү 
Rabinowitz (1954), using exactlY pt jl 
inventory and comparable : шей 
diametrically opposed results a » «fa 
to answer the question of whet)! 


peer , 
egre" 3 
leg ait 
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bw 


aS possib] 

й е оп 2 

titude Inventory the Minnesota Teacher At- 
A number i 


al of lec 
sence of re studies report an apparent 


S i А 
Steg, ае distortion by identified 
рше ie Wee inl 1952; Corey, 1937; 
1952; Olson Mason, 1948; Hamel & Reif, 
Rat study se 6). All but the Hamel and 
n] шр e students as Ss. Pelz 
FAO confid, the effects of full anonym- 
E ing d саи with the latter con- 
m i oe ned by individual identi- 
the tically "- Кы staff only. Although 
in WO conditi ifferences obtained between 
agis башы oF the author qualifies his 
ation tested the special nature of the 
Vo т, ed. According to Pelz, 
Чу Perso: 
Sere T nnel studi 
curity, “Vice mene were largely covered 
s, which provide high job 


‚ (2) 
qh In 

m Bene: 
зше та] 
Q) 1 


In 
i Bence: 
tog ету ral 

Mig ety op t the personnel had confidence in 


Seya, Mtia] the > 
i ng Sf the auis. diis a staff and in the 
ls o deed. was built up over 

к Lp. 90]. 


» the е 
теп tere oM had high confidence 
rity and concern for employee 


ide 05е 
(ес (1960) — 
vestigated the effects of 


ttg atio 
Nt, on A 

+ : toward oe expressed by college 
stg ile En | reading in general and 
iq ise m hey m course given in the 
NUS oat Although he found 
{зө 19 апо cant differences between 

$ nymous groups in attitudes 


Wa diffe Ward 
T t Ga 
ng Mly е м specific English course; 
Signin 4 опа pe the two group means 
differ O-point scale. There were 
MD Senera] mue in attitudes toward 
ме Часе th - Thus Rosen concludes 
D “шу! "Ae liter 
|; а, зева ature and the study reported 
M the qu at identification of respond- 
to, ely {АП hi estionnai 
NUM to ree ЕМУ th ire surveys conducted 
Stia, = Ssult jp & hreatening circumstances iS 
Map iden? Signi; win aes statistical or practica 
"tq ifeq ficant _in the few studies where 
respon, differences between anonymous 
ET those "^ have been reported, the 
Practical pte has been incon- 
poses [p. 6791. 


e is Я 
ap 216 in indication that there i5 
" entific ш between the re- 
ere i. "a and nonidentified 55. 
so evidence that suggest 


153 


rence exists. For example. 9 
a differe: ists. F xample, Green (1 51) 


The literature that is relev 
"- ile а vant to the pr i 
жу rag But what does exist Har core и 

bn ly that overzealous applicants fo р E» 
на in real life can, will, and do bi r 
answers on tests that are amenable t ha 
havior—especially if they think they il а 
with it Гр. 505]. ды 


In addition, Wesman (1952) found that 
the same group of 73 Ss responded signi 
cantly differently when assuming two di igni- 
response sets at different tim Y нер 
the same questionnaire Furth ID. ЖИК 

i ermore, these 
two sets of answers were judged to have 
high degree of face validity when ei 
against the two profiles Ss had been asked 
to assume. 

Kahn (1951) and Metzner and Mann 
(1952) obtained significant differences be- 
tween attitudes expressed in an anonymous 
questionnaire and in a face-to-face interview. 
while Elinson and Haines (1950) and Benson 
(1941) report similar findings in comparing 
anonymous and identified responses to the 
same questionnaire. However, since Elinson 
and Haines were dealing with a population of 
enlisted men, while Benson surveyed 
1 Republican community 
in Maine about voting preferences, it is pos- 
sible that the identified 5s in these latter two 
studies were confronted with implicit pres- 
d the “right” way. 

1956) dealt more 
ceived threat 
tified Ss will 
n their 


army 
residents of a sma 


Dunnette ап 
directly with t 
as a determinan 
distort their responses 
experiment, all responses Y 
ymous, but «psychologica 
varied. In one condition, ап 
naire was administered to Ss 
staff member from outside Ss’ organization, 
while in а second condition it was adminis- 
tered by an official of the firm in which the 

being conducted. It was found 
еге employees feelings of ano- 
threatened by the presence of an 
company, responses to the 


questionnaire were more favorable; (5) dif- 
ounts of response distortion were 


ferential am 
obtained depen 
items; and (С 


ding upon the content of the 
) employees experiencing а 
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TABLE 1 


COMPARISON OF IDENTIFIED AND ANONYMOUS SAMPLES 
IN PLANT С on DEMOGRAPHIC ITEMS 


Identified Anonymous 
Item * 
X |oX | N Ж | a N t 


Length of | 4.08 | 1.46 | 410 | 4.03 | 1.41 | 428 | 0.50 
Education 3.21 | 0.69 | 404 | 3.20 | 0.69 | 427 | 0.21 
Shift 1.50 | 0.63 | 411 | 1.49 | 0.61 | 4.28 | 0.23 
Age 2.33 | 1.05 | 411 | 227 | 1.08 | 429 | 0.82 
Marital 1.20 | 0.40 | 411 | 1.18 | 0.38 | 428 | 0.74 

status 


threat to anonymity gave fewer and shorter 
write-in comments, 

If one postulates that threat is the under- 
lying cause of the degree of distortion ob- 
tained in some of the referenced studies, one 
would also expect that the manner in which 
Ss are identified would have an effect. If Ss 
are identified in a totally impersonal manner, 
we would expect less faking than if they 
are told face-to-face that their questions would 
have an identifying characteristic even though 
under both conditions of identification Ss are 
assured of the confidentiality of their re- 
sponses, 

Finally, in accordance with Dunnette and 
Heneman (1956), not all items in an attitude 
survey should be of equal threat. One might 
expect that items dealing with things of a 
more personal factor such as attitudes about 
an individual's manager would be more 
threatening than those dealing with im- 
personal factors such as working conditions. 


In summation, three questions have been 
addressed: 


1. Do Ss who are identified respond differ- 
ently toa company-sponsored attitude ques- 
tionnaire than Ss who remain anonymous? 

2. Does the manner of identification have 


an effect on the degree of difference? 


that S is respond- 
ifference? 


3. Does the kind of item 
ing to affect the degree of this d 


WIRE Y WU pm ac 


Subjects 


The Ss included all manufacturing nonmanage- 
ment employees from Plant D and Plant G, two 


5 " ^ :ndustril 
manufacturing installations in a large indu 


EN {0 
А 290-item questionnaire was administered, 
Ss in both locations. This questionnaire bee 
eral attitude inventory centered around Ss aa 
tion, including such areas аз attitudes 


salary, job, and management. 


corporation. 
The Questionnaire 
Independent Variables Е. 
Б ш 
Identified versus anonymous subjects. re tol 


з own 
mental code number but not to ue z we 
personal identifying number. In all cas to ident 
assured that no attempt would be made erso i 
anyone to management. Only people in pars? 
Research would ever make use of h os 
identifications and then only for regato ove! 
In other words, confidentiality was Ce not: y 
anonymity in the case of identified So сано Jr. 
High versus low threat in the identi e ce " 
cedure. The high-threat manipulation tot tions H 
Plant D. Under the high-threat от ерат 
identified Ss were informed in шег ave B5 
by their manager that they would x qu i 
down an identifying number on Hos iD ye 
naires when they received their boo! in both 
auditorium. There were 111 employees ! " 
experimental and control groups. 1 in P! " 
The low-threat manipulations took i 6 
С. Under the low-threat ошол, proc mu 
said nothing to the identified Ss. Т ery oth? pe 
identification occurred by assigning fue int 
to the identified group as they wa А ini 
room where the questionnaire was nen 
There were 411 employees in the experi M 
and 430 in the control group. jonnait® ji 
In both plants, the completed questo (fe mu 
collected in an identical manner. Both і һай finc 
anonymous Ss were told that when iem Jac? gt 
answering the questions, they were box 
questionnaire booklet in a сарат an s 
front of the room. Identified an ае D "i 
questionnaires were collected in the КА givin’ | 
the administrator was careful to avoi as «che il 
respondent the impression that he js any y 
up" on any of the questionnaires Б giti™ Ш 
during administration or collection. In mo. $5, И 
method of identification insured that à 5 
would appear on his booklet. BARES d Lar. 
deposited his answers in the collection ойе го, 
free to leave the room and return to М ШОМ P 
In Plant D, the identified and anony детоЁ д) 
were matched prior to the test for à | 
characteristics such as age, education: assist 0 
of service. In Plant С, where random 


ео үн? 
stele 
and the two groups were compared а Fat th 
significant differences. Table 1 shows 
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Stoups in p 

1 

tquivalent sai S were, for all practical purposes, 
en place, hat random selection had truly 

Dı 

ata Analysis 

Within 


n both 
y, ach item Een the data were broken down 
de Mentifieq or ing to whether the respondent 
Ween the grou anonymous. Statistical significance 
est on the ы originally determined using 
Severa] ue. means for each of the items. 
о be beu а substantial number of 
$ HE P a priori from the data 
met ns na 290 items, 114 were re- 
lt with e following criteria: (a) The 
dred thirt subjective, attitudinal areas. 
a items had to be discarded be- 
; epi factual or dealt with 
alysis ample, all demographic items. 
BrOups in ei evealed little or no differences 
Cardeq +, 10% fen either threat condition on these 
ш т арро Нуе sample of these dis- 
t шше in Table 2.) (b) The items 
Possible response categories in 


EN Prop, TABLE 2 
ENT RE 
REPRESENTATIVE SAMPLE OF ITEMS DiscarDED DUE TO Bene P: 
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both locations. Twenty-two items did not meet 
this criterion. (c) The items employed linear scales 
which were directional with regard to favorability, 
thus making a comparison of mean differences а 
meaningful one. Three items did not have linear 
scales. (d) The items were responded to by at 
least half the Ss in each of the four conditions. 
Twenty-one items (dealing with change over time), 
id not be answered by at least half the Ss in 


coul 
and had to be excluded from the 


each condition 
analysis. 
RESULTS 

Tt is clear that identifying Ss makes a 
difference in their responses to the question- 
naire. Under both conditions of threat a 
substantial number of items were responded 
to significantly more favorably by the identi- 
fied group. Using а one-tailed £ test with a 
significance level of .05 as the criterion of 
significance, one finds that 39% of the items 
are responded to more favorably under the 


RIMARILY OBJECTIVE 


Plant D (high threat) 


Plant G (low threat) 


Identified 


Anonymous 


Identified Anonymous 


oX oX 


N t X N 


0.30 0.33 


1.36 | 0.75 | 111 | 1.32 | 0-62 


1.63 | 0.81 | 111 | 1.60 0.61 


1.25 | 0.44 | 110 | 1.36 0.48 


2.95 | 1,37 | 111 | 2.68 | 140 


1.92 | 0.53 | 109 | 1.94 0.64 


111 1.59 | 0.49 | 409 


111 | 0.43 0.80 | 410 | 1.46 0.76 | 427 0.19 


111 | 0.31 0.80 | 410 1.76 | 0.82 | 428 0.71 


0.50 | 410 1.43 | 0.50 426 0.29 


111 


1.30 | 411 2.61 | 1.29 | 429 0.22 


111 


245 | 0.57 304 | 2.17 | 0.59 | 412 0.49 


110 
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TABLE 2—(Continued) 
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— 4 


Item entified 


Plant D (high threat) 


Anonymous 


ant G (low threat) 
— 


р 


| Anonymous 


—— Га 


Identified 


X leX| N| X 


| eX 


oX oX 


І would most prefer (1) a 1.40 | 0.19 
job where my instruc- | | | 
tions are quite detailed 
and specific or (2) a job 
where my instructions | 
are very general. 

How frequently does your 
manager come around 
to see how things are 
going? 

How many suggestions 
have you submitted to 
the suggestion program | 
during the past year? 

Think back to the last 1.52 
time you considered 
Secking a transfer to an- 
other job. (To what) 
degree (did an oppor- 
tunity to improve your 
skills lead) you to con- 
sider such a change? 

How much “say” do you 
think (higher plant 
management) has in de- 
ciding the amount of 
work you should do on 
your job? 

How important would in- 
teresting and challeng- 
ing work be to you in 
choosing a job? 

How important are com- 2.38 
pany medical benefits | 
to you? 


1.43 | 0.50 


| 0.59 | 110 | 3.11 


3.61 | 1.34 | 110 1.37 


0.64 | 104 


2.98 | 1.41 | 110 | 2.92 | 1.34 


3.38 | 1.36 | 104 | 3.41 1.33 


1.19 


0.2 


0.45 0.50 1.47 | 0.50 


111 [0.98 |3.23 | 0.62 | 410 | 3.23 


424 
110 | 0.82 4.00 407 | 3.96 | 1.19 


ов 0.66 | 375 


0.84 0.64 


416 
111|032 |233 395 | 2.30 | 1.28 


397 


102 | 0.16 1.33 | 393 | 3.65 


416 
107 232 | 1.14 | 4 


1.13 | 400 


*$ «05; 
Db < 1025. 


Condition of high threat and 55% of the 
items are responded to m 


Another way of looking at the data involves 
comparing the identified and anonymous 
groups in terms of the percentage of Ss 
responding in the two most favorable and/or 
two least favorable response categories on 
each item. Table 4 shows the mean percentage 
differences in these categories for both con- 


iW 


OF an 
е сай 


gi 
ditions of threat, as well as the bn 
differences. Again, the effect of ide! 
is clearly in evidence. 

While these results demonstrat th ide 
sure of a strong effect associated о 2 
fication of respondents, they are а tion vi 
what contradictory to the Gem, vf 
personal identification (high pets Са 
produce a greater effect than impe atio g 
threat) identification. Cursory exam sit ИТ 
the results indicates that the um of 
pens. In the low-threat condition, 5 ified 


Lu 
: крче Jenti 
items discriminate between iden 


(5 
Phi 
e the "n 


| 


m7 12 
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anonym, 
ous Ss 
je „98 and 7 
ition do А Cae 
ег analysis o 
м this P A of the data, however 
Ove differs npression to be in i; 
aviñg EE are attributable ai tis 
flee different-sized sample 
= a Since pues than in Plant G 
" in Plant D total sample of 222 Ss 
mening application as opposed to 841 in 
of the standard £ test 


thy ат 
ee much g 
Ies. reater iff 
Plan perimental ater mean difference be- 
бер than in Pla and control groups in 
ant G to achieve a given 


To Statistic 
Vides Пау, 
ott Us With’ 
ef he total y, 
Че, al va 
‘Ware, ‘a 
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D significance 

nere 1 isti 

de e а statistic which pro- 

guod nate of the percentage 
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п by the ays’ (1963) omega- 
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er the omega-squares 
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+ an tte 
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ТАВІЕ 4 


DIFFEREN v 
S IN PERCENT DISTRIBUTIONS OF 
NTIFIED VERSUS ANONYMOUS SUBJECTS 


Two most Tw 
Condition favorable Кураш 
тезропзе response 
categories categories 
— D (high threat) 
JI percent differ- 5 
bem +6.65 —5.09 
Range of percent |—71 to 2 
ng 21. 
differences шы ш, 
Plant G (low threat) 
M percent difier- 4 
ence pan M 
Range of percent —39 to +12.2 2.5 
differences н oe ne 


Note.—Differences = Identi 
Note. f = ifed on two categori i 
Anonymous in these two categories. раннее ‘пипа 


61 cases of Ше former type and only 38 of 
the latter. This difference yields a chi-square 
of 5.16, significant at the .025 level with 1 
degree of freedom. In fact, then, the high- 
threat manipulation yields a significantly 
greater effect than the low-threat manipula- 


tion." 

The remair 
is, does the nature 
thing to do with d 
tion? In an attempt to resol 
representative items for the 
tion were factor analyzed.” 


selected а priori from thre 
of items: (a) those which on the surface 


did not appear to be threatening but which 
minated between identified and anony- 


to be answered 
of the item itself have any- 
etermining response distor- 
ve this issue, 60 
Plant G popula- 
These items were 
е general types 


ning question 


discri 

mous Ss; (2) those which appeared threaten- 

ing and did not discriminate; and (c) those 
threatening and did 


which appeared to be 

indeed discriminate. 
Six significant factors eme 

along with representative iter 


rged. They follow 
ms in each: 


was selected rather 
since the effects of 


ea 
1The Plant 
{оп were originally 


е Plant D popul 


than th 
the severe igh-threat manipulat 
expected generalize to items which would not 
ordinarily be threatening enough to yield a sig- 
nificant difference. 

2]In the high-threat condition, values for e? for 
the items in question ranged from 00095 to .10390 
Under low threat, the range was from 00020 io 
101689. 
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TABLE 5 


PERCENTAGE OF IrEMS LOADING at Least .30 ох EACH 
FACTOR THAT DISCRIMINATE BETWEEN IDENTIFIED 
AND ANONYMOUS SUBJECTS UNDER Вотн 
CONDITIONS OF THREAT 


No. items Percentage of 
Factor loading .30 or | items that 
higher discriminate 
Attitudes toward com- | 13 54 
pany and top plant 
management 
Ratings of immediate 8 0 
manager 
Extrinsic job factors 3 67 
and grievance chan- 
nels 
Attitudes toward sal- 6 67 
ary and advance- 
ment 
Intrinsic job factors 6 33 
Workload 3 0 


*7 additional items with a loading of at least .30 on this 
factor in Plant G did not meet the criterion of 50% response 
in Plant D, 


Factor I. Attitudes toward the company 
and top plant management. (19 items had 
primary loadings on this factor.) 

1. How would you rate top plant manage- 
ment on fairness in dealing with employees? 

2. How would you rate the plant as a place 
to work? 

3. How would you rate top plant manage- 
ment on recognizing superior performance? 

Factor II. Ratings of immediate manager, 
(8 items had primary loadings on this factor.) 

1. How would you rate your manager? 

2. How would you rate your manager on 
assigning the right jobs to the right people? 

Factor III. Extrinsic job factors and. griev- 
ance channels. (11 items had primary loadings 
on this factor.) 

1. How often is management fair in listen- 
ing to employee complaints? 


2. Rate your job on how well work is 
scheduled. 


Factor IV. Attitudes 4 
advancement. (9 items ha 
on this factor.) 

1. Rate your pay considering duties апа 
responsibilities. 

2. How satisfied are you with your advance- 
ment so far in the company? 


oward salary and 
d primary loadings 
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Factor V. Intrinsic job eee (9 items hal 
primary loadings on this factor. m 
1. How satisfied are you that your abili 
and training is properly used? m. 
2. How do you like your job—the kin 
work you do? J 
Factor VI. Workload. (5 items had primat! 
loadings on this factor.)? T 
i. How do you feel about the amoun 
work expected of employees? " 
2. Suppose you did more work 
quired for the next few months . a 
your manager expect you to do still mor 
Of the six factors three appear 


an È 

S 

: 4 ing ' 

threat and two low in threat. Usi B nt 


уой 
e, 
pi 


е 0 
primary loading аз an arbitrary alte | 
finds that of all the items that pe dis 
criterion for Factor IV (salary) Ó pof 
criminate between the identified. t eh 
identified groups (Table 5). It is 
therefore, that items dealing W! š 
present a considerable threat to E s 
responses can be identified. This 1077 "gi 
supported by the fact that two of gr P 
with primary loadings of .30 os" v й 
Factor I that discriminate under ł0% ad t 


; elat" „ 
are either directly or tangentially "5 b 
Joye ү 


OU f 
У мій 


money matters (ie., *How good 
management do in evaluating e™P 
merit pay increases?” “How woul 
the plant and its top manager on р”). ) 
a chance for employees to get ahea 2 тё? 

Factor I (rating top plant ке te v 
produces seven items that p e | 
six which do not. Two of the po ШЙ 
apparently unthreatening аге t oni 
you rate top plant management , i 
‘Fairness in dealing with employees gidu”! of 
‘Consideration of employees as indi close y 
On the other hand, items with ould 


M 
dy 


я 
ceptual similarity such аз, “НО м, ty 
rate top plant management on Г» do , f 
ployee complaints are handled relat 
criminate and thus seem to be y? 
threatening. uh. dab fac ur 
Labeling Factor III (extrinsic 1 dure це 
and grievance channels) as “highly ten" i 
ing” seems justified but somewlha 06 
ир adi 


" ds a0 ij 
? The total of primary loadings ай ШУ bu 
because 1 of the items had a split P” und? 


*Only those items that discriminate 
conditions of threat will be dealt with. 
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analysis, am р in the Plant С factor 
Cause they ut three had to be discarded 
of the two Mic not responded to by 50% 
tds Шеше ampleg in Plant D. The dis- 
nd Somewhat сап with change over time 
Population had ess than 50% of the Plant D 
to ser them been employed long enough 
Tt them. р eate and were told 
Aa И а на hesitates to designate 
а n two of the p of big threat, even 
T Scriminate bet ree items loading on it 
ween the identified and 
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The 7,05, Sub ^ 
he least th samples in both plants. 


vit Work 
the, "Min esum. None of these items 
йе а Ctorg Реа of .30 or better on 
tinea between the identi- 

hb petat con ‘res groups even under the 
їз) Sis oe Factor У (intrinsic 

aly 4 moderately threaten- 
ough te к, the Six items are 
P aie iscriminate between 
1 is Ss in both condi- 
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а а meth Discussion 
һу data ds ste Bical viewpoint, the find- 
t апа, indicate are reasonably clear-cut. 
be Pany ement An if we wish to identify 
dfe p Donsoreq atti ag people in a 
бы o. oing 5 attitude survey, we may 
to Ateni ap up to a point. While 
s t “pst that identification is 
a ке and thus leads 
Upon i. n, the degree of distor- 
Wig adis. € King е way identification takes 
% n Qua is of questions asked. When 
Dye à с Ге mug Personally told that his 
=, crab bear an identifying mark, 
he i B E thoug T amount of “faking” takes 
К rang ses, my assured confidentiality 
on анд ЧУ а Эп the other hand, when 
ed gror Ssigned to an identified ОГ 
this т he enters the examina- 
aki y be sufficiently 1655 
КИЛ » to produce comparatively 
he ed the personal con- 

€ ву ual's anxiety thresho 

еп marginally threatening 
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Ta pape arouse sufficient feelings of 
e uce distortion in the sociall 

desirable direction. When this personal y 
knowledgment of identification is absent the 
fact of identification usually does not, in d 
of itself, lower the anxiety threshold. tens 
to create response distortion, except here 
the items themselves are intrinsically threaten- 
ing. 
Less clear is the degree of threat that seems 
inherent in different conceptual types of items 
analyzed. In accordance with Dunnette and 
Heneman (1956) we find that some items 
more distortion than others. We 
find, for example, that items dealing with pay 
and with the adequacy of evaluations made 
by management with regard to the individual's 
skills and abilities are sufficiently threatening 
to produce distortion under even the low- 
threat condition of identification. On the other 
hand, items dealing with work pressure and 
contrary to the Dunnette and Heneman find- 
ings with attitudes toward the individual's 


manager do not produce much distortion at 
all A simple answer as to why differential 
distortion occurs might be that there are 

he job that are “OK” 


laint. 


produce 


topics for comp 
as the employee is giving 
effort and productivity, who could object if 
he merely observed that he had more work 
to do than perhaps was reasonable? The 
worker has no control over the amount of 
work that is assigned to him, and consequently 
takes no personal responsibility for it; as 
long as he imagines himself as giving maxi" 
mum effort, he does not fear negative sanc- 
tions if he complains about the amount of 
work inherent in his job. 
Certain other however, may have 
i ing taboo. Salary 


acquired the mys 


is a prime illustration 0 
+ mterviews that we have conducted will 


ly a direct answer to the question, 


do you compare yourself. when 


your salary?" Instead, they will 
g themselves with anyone, even 
though later on in the interview they may 
prefix a comment about their pay with “Well, 

>» Perhaps employees perceive 


compared (о... 
top management as more sensitive to criticism 
concerning their salary programs in general. 


rarely SUPP: 
“To whom 
evaluating 

deny comparin 
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Moreover, in our society it is probably less 
legitimate to complain openly about money 
matters or the way one is evaluated. Both 
involve opinions about one's personal Worth 
and require very subjective arguments in 
support of these opinions. These. arguments 
are therefore difficult to substantiate and in 
the absence of substantiation could render 
the individual open to direct attacks upon his 
sense of personal worth. If one felt that there 
was any possibility of an open confrontation 
of this sort he might be constrained to distort 
his responses in order to avoid such a threat. 

A major anomaly of these results is the 
lack of positive distortion among the identi- 
fied Ss in rating their manager. Certainly if 
our reasoning that threat is an important 
factor in determining the degree of distortion 
were correct, one would expect ratings of 
one's manager to be highly threatening and 
therefore conducive to more distortions as 
Dunnette and Heneman (1956) find. Per- 
haps the difference in the two findings is 
due to the differences in the manipulations 
performed. Whereas Dunnette and Heneman 
have a condition of "psychological" ano- 
nymity, we do not, since the questionnaires in 
our study were all administered by someone 
in the company. A positive bias might have 
already taken place with regard to ratings of 
immediate management in our population. 
Consequently, there may have been less room 
for an additional biasing effect. 

In any event, a full treatment of this sub- 
ject is beyond the Scope of this research. 
Suffice to conclude that questionnaire items 
do contain varying degrees of threat and 
Consequently are open to varying degrees of 
distortion, Thus, when attitude survey work 
is conducted, be it with questionnaires or 
interviews, care must be taken in both 
content and method to assure mini 
tortion due to threat associated 
identification of the respondees. If the con- 
ditions of personal threat are low, then some- 
what less distortion may be expected. But 
even so, items dealing with salary and 
ratings of top plant management may рго- 
duce significant positive distortion. 


mum dis- 
with the 
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VIS 
ION AND KINESTHESIS IN THE ACQUISITION 
OF TYPEWRITING SKILL' 


LEONARD J. WEST 


Ci — r 
ity University of New York (Division о] Teacher Education) 


through 108 wpm typed from ordinary 


266 = 
Ss at typing skill levels from 9 
tions, under instructions to indicate 


prose i 

when кые visual and nonvisual condi 
зе ; 
y sensed having made an error. Results confirmed the hypothesis of a 


Swift rise i ien 4 
typists a куч dependability from low levels among beginning 
an pom mig a plateau from intermediate through expert levels of skill; 
отека ер found between kinesthetic dependability and skill level. 
throtighout Еа was at significantly lower levels than all-senses feedback 
e m he range of typing skill, while deprivation of vision had no 
Those p EP but resulted in large and significant increases in errors. 
typewrite gs suggest the free use of vision їп early stages of learning to 
‚ as contrasted with the conventional insistence on so-called “touch” 


operation at the start. 


Con 
cern; 
Under}: Thing the 5 
поо te acquisiti ensory processes that any direct measures of extent of dependability 
hag skills, Hon sition of complex perceptual of kinesthetic cues at successive stages of 
zik (1932) and Fitts (1951) skill. 
pose of this investiga- 


im, PPothesi 

Dong Y as pu kinesthetic cues come The second major pur 

та р ing respon asis for making and for tion was to assess the effects on performance 

рну акеп p] ses only айег some learn- (speed and errors) of deprivation of vision. 
ace on the basis of extero- Earlier studies (e.g, Сат, 1927; Koch & 


t e sti 
Уреру Stimuli, primari oa A A А 
narily vision. Taking the Ufkess, 1926; Zigler, 1932) had routinely 
to have large 


a ski iting PRA 
Wa resume as a prominent example of shown deprivation of vision 
‘On р 10 Of kin io depend increasingly on negative effects on acquisition in maze learn- 
UM as one е sthetic cues, this investiga- ing. Insofar as the conventional instructional 
Э its two major purposes esti- insistence on so-called “touch” typing from 
the start of learning flatly contradicts the 


nd the accumulation of 
ual motor tasks, 
lect direct evi- 


*edb f thi 

а е1 

ад Ck at ina of dependable kinesthetic 
Cessive stages of typing skill 


led in 

el turn 

i 0 , : 

teste Sci of the relationship between 


existing hypothesis à 
evidence for 0 


it was thought desirable to со 


{Poth oo of utilization of e 
NU Sized shift а is the extent of the dence for the typing task. — | - 

active g $ toward rom dependence on €X- Specifically; then, the primary objective 
e hid luli as — pim on proprio- was to test the hypothesis of increasing de- 
чаба) h 1963), kill is acquired? Fleishman pendability of kinesthetic cues as skill is 
Мо kites in their investigation of acquired and, in fur to estimate the rela- 
ki па Perform esthetic sensitivity, showed tionship between typing skill level and extent 
qe Sth Borgo. e later in learning a tWO- of dependable kinesthetic feedback. That is, 
ht; t “Hon task by those high in if, as performance becomes habitual, pro- 
s : tive feedback or “feel” comes into 


ng play, then kinesthesis should be at 
_ low levels among beginners, but should rise 
nois ag skill is acquired. A second objective was 

tent of dependable all- 


la] Su Sensitivit : 3 
Up рогі f ity, thus furnishing tan- price? 
or Fitts’ hypothesis, but not 


N 1: 

ly, 5 
N Уор... Tes 
Noy sity Search 
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vas begun at Southern ИШ 
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nA mk ntinueq 

Ды the Rud aee HL Ihe "OM University of 
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(speed and errors) of deprivation of vision. 
The rationale underlying the experimental 
procedures is that if a correct motion “feels” 
right, then an incorrect motion should “feel” 
wrong. Accordingly, as will be described, 
the basic datum is the proportion of errors 
of the kind amenable to kinesthetic feedback 
that were in fact sensed as wrong when 
working under visual and under nonvisual 
conditions. Whether “error detection” cap- 
tures all that could or should be meant by 
kinesthetic feedback is unknown, but it is the 
defining process of the present investigation. 


МЕтнор 
Subjects 


Of a total N of 266 typists, 
from 9 through 108 words per minute (wpm), all 
but 10 of the 224 subjects (Ss) at skill levels be- 
tween 9 and 74 wpm were students in 11 intact 
typing classes, taught by 8 different instructors, in 
4 different high schools and colleges. Of the re- 
maining 42 Ss (at 75-108-wpm skill levels), most 
were employed typists, a few were typing teachers, 
and a few were finalists in a national contest for 
high school typing champions. The relevant popula- 
tion is one of levels of typing skill (as measured by 
gross stroking speed in ordinary copy work under 
normal conditions); and the sample data are in 
terms of skill level and not in terms of stage of 
training or amount of work experience. 


ranging in skill 


Design 


All Ss typed under each of three conditions, in 
turn: 

Condition 1: Normal, that is, under the con- 
ventional and familiar instructions to follow the 
сору word by word, This condition provided the 
basis for classification of Ss according to skill level. 


Fic. 1. Paperboard shield for typing under non- 
visual conditions. 
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Condition 2: Under instructions to space once a 
retype instantly any word thought to ques 
mistyped, before continuing with the next Mrs 

Condition 3: Under the same special i 
as for Condition 2, but deprived of visual d 
to the typewriter or to the typescript Marg im 

These three work conditions are referred (Visus 
after as Condition 1 (Normal), Condition 2 Mer 
le, all-senses), and Condition 3 (олии 
kinesthetic). The design is not orthogona iy 
absence of a fourth condition (visual A. 
but without instructions to retype in P her 
sensed error) was due to the inability o the i 
to make sufficient class time available to ot pt 
vestigator. Accordingly, this study does coran 
vide a pure measure of the effects on E furnished 
of visual deprivation, Instead, Condition ber. f 
a measure of all-senses feedback and p Ж 
accounting for that part of Condition retype 
attributable to the novel instructions to 2 Sn 3 
the case of error. That is, Conditions f prit 
provided estimates of the effects of Ma 0 
tion, holding constant the novel ins 
retype. 


vior 
in 


Test Content and Administration 


3 sets 0 

Test copy consisted of three аш in ай 
ordinary prose (approximately 815 Were differ 
set), composed so as to be of ыа Т) Ye 
as measured by syllabic intensity une Ü syll 
of syllables per word). Specifically, eid repr | 
intensity of 1.40 is conventionally taken cation 
average difficulty of copy materials for words H 
typists, each successive 100 dictionary was Шр 
copy contained 140 syllables. Test сор as M 
in counterbalanced order across Rio unde! s 
typing skill levels. Instructions to dinary К 
three conditions were to type at their ОГ giving sop 
aiming at their best overall performances оп, 


account to speed and accuracy. Une "try. of 
2 and 3, Ss were in addition EE 3s man yy 
‘catch’ (as demonstrated by retyping о 


the errors you do happen to make as ун ptai™” 
can.” Further, a sample of typescrip ropri®t® ой 
every class of typing error, with apP the MT 
typing, was examined by Ss before гес of 
Session, as an illustrative model. Also, 
novelty effects, Ss were given a minnie 
unscored practice just before formil | exce" y, 
Conditions 2 and 3. Finally, with 1 рег 
each S worked at his own accustomed pn 
For those Ss who were students in tra 0 
ditions 1 and 2 were administered A теб, 
during one class period, with appropri inistero 
tween the two. Condition 3 was adm were 4d 
class the next day. For those Ss 19, wet? th 
ployed typists, all three work condition Р d Й 
ministered the same day, їп 1-2-3 orden esr act 
appropriate rest between work session hs, pal? ШИ 
dition order was deliberately not clit of й 
in order (a) to maximize the relia Т skill it? 
basis for classification of Ss according rienc® 
and (b) to provide maximum expe 


| 
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VISION AND KINESTHESIS IN TYPEWRITING 


Tetypin 

Visual i pm prior to working under non- 
tions беа 12 Each of the three work condi- 
Preclude inter 12 continuous minutes of typing. To 
пй Бар ОД during the work session for 
length wa г in the machine, paper of sufficient 


s 
cut from teletype rolls. 


Apparatus 
Deprivat; 
ation TUS 

d у paee (under Condition 3) was 
ounces из of a paperboard shield, 
е neck dd As displayed in Figure 1, an 
vidual differ ter and waist strap provided 
у) While holdi ences in body build and in visual 
the У blocking P» the shield stably in place, yet 
S view of the typewriter and of 


ha YPescript, but WO 
neath eee free movement of the 


adjustable 
for indi 
acuit, 


ata 
jd о Consist or 
measures of speed (gross wpm) 


tongi total 
u, tio error 
S under each of the three work 
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or the omission of words or lines ii 

Level of dependable feedback ae are 
senses) and nonvisual (kinesthetic) conditions is 
defined as the percentage of "applicable errors? 
followed by immediate retyping, including the very 
occasional retyping of words that had not originally, 
been mistyped. The 266 Ss were classified (on the 
basis of their speed under the normal work pro- 
cedures of Condition 1) into ten 10-wpm skill 
ranges, but with unequal Ns in each skill range. 
To provide unbiased estimates of means for the 
entire range of typing skill, an equal frequency 
subsample of 189 Ss was drawn (21 from each of 
9 skill ranges, combining 85-108-wpm typists into 


one cell). 
RESULTS AND DISCUSSION 


esented in turn for (a) 
k, (b) kinesthetic versus 
and (c) effects on speed 
deprivation. 


Results are pr 
kinesthetic feedbac 
all-senses feedback, 
and errors of visual 


Dependable Feedback 
With percentage of dependable feedback 
defined as the proportion of all errors amen- 


able to kinesthetic feedback that were in 
der Visual and 
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theses), and Ws (circled) for № = 266, dis- 
tributed unequally among ten 10-wpm skill 
ranges, are displayed in Figure 2. 
Descriptively, it is apparent from the data 
of Figure 2 that there was a sharp rise from 
low levels of kinesthetic feedback among 
novices. However, the long plateau there- 
after was not anticipated and may or may 
not be characteristic of other skills. The 
surprisingly low (50%) levels of dependable 
kinesthetic feedback among 100-wpm typists 
contradicts and shows to be a delusion the 
common self-report by such typists that 
they “nearly always” know whether they 
make an error because it “feels” wrong. The 
skillful typist is apparently simply not aware 
of the frequency with which he steals corner- 
of-the-eye glances at keyboard and/or type- 
script as guidance for responses and for as- 
certaining their correctness or incorrectness. 


TABLE 2 Г 
з IN Vist: 
MEAN NUMBER OF APPLICABLE ERRORS UNDER 
AND NONVISUAL WORK CONDITIONS 
(ву SKILL LEVEL) 


Increase 
nonvisti 
———— visua! 


M no. errors 


Skill level 9 Өр 
(gross 1 ү 
wpm) Comi na: 
retyping 


No. 
errors 
ди" 


\ 


Grand M^ 


each of 9 skill lev 


One-way analysis of variance for percentage 


of dependable kinesthetic fe 
and within 9 skill ran 
sulted in an F of 5.28 


(df — 8/180). 


ANALYSES OF VARIANCE FOR I. VISUAL 
FEEDBACK, IT. APPLICABLE ERROR 
ERRORS, AND IV. SPEED 


Tukey’s signific 
showed the differences in depend 
to lie between the 9-14-wpm ty; 
of the other more adva; 
tween 15-24-wpm typi 
wpm levels (ф< .05) 
interskill level difference. 


TABLE 1 


edback (between 
ges for № = 189) re- 
3, for which р < .001 
ant gap test 
able feedback 
pists and each 
nced skill levels and be- 
515 and those above 55- 
No other significant 
5 were found. The hy- 


AND NONVISUAL 
5, ПІ. Toran 


— II. Applicable 
I. Feedback pus 
Source df 
MS г MS F 
Ronditions (C) | 1 | 3262.48 | 187.22* | 937.63 | 6214" 
Range (R) 9| 9068| 522*| 1928) “Tag 
CXR 9| 1713 1445 
Error 512 | 1737 15.09 
Total 531 
E IV. Speed 
Conditions (С) | 2 | 682.27 | sios* | 105.75 | 131.698 
Range (R) 9 28.96 1.32 2515.66 3138.83+ 
C XR 18 23.13 1.05 2.18 2.72* 
Error 708 21.95 .80 
Total 797 


Note.—N = 266, R = 10. 


жр «.001. 


эзуу tete tn i rA S 


23.22 
15.38 
13.00 
14.95 
19.64 

8.28 
15.08 
14.00 

7.00 


28.27 10 
29.00 64 


ZNNNUNNON 
Sue 
Зее 


Total 200 


= 
= 


| = 14.02 
159 23.27 37.28 


к in! 
Is, combining 85-108 wpm 1 


Jit 
aoe dabill 
pothesis of a significant rise in depen 


m 
of kinesthetic feedback from low eee al 
beginners is thus confirmed; but we ris? 
clear that there is no further sign! n odes! 
in utilization of kinesthetic cues one „10 
levels of typing skill have been reac js $5 
curve for utilization of kinesthetic sentia 
function of typing skill level is € 
negatively accelerated. 


ck 
Kinesthetic versus All-Senses Feedba whe" 


The losses in dependable feedback al 
typists were deprived of vision аг cn js 
observable in the differences Hep n! | 
and nonvisual feedback percenteg™ los e 
Figure 2, namely, about a prim urth Ж 
9-14-wpm typists, about a cone ift 
for 15-84-wpm typists, and about aly к 
loss for 85-108-wpm typists. An pow? ! 
variance for the data of Figure 2 !5 E 
Section I of Table 1. dit 


n 
‚© sh 


As shown in Table 1 (Section I) o 
effects and effects for each of ЕЁ pla. 
ranges were highly significant. On ee vis. 
ble hypothesis that differences БЕТ ect? js 
and nonvisual feedback levels ought Р nal 
with increases in skill, the ape n" 
shows no significant interaction Capt ' ty 
condition and skill range. How й ей”, 
absence of significant interaction is : , 
due to the quite fine stratificatio па 


e 
i ara 
levels in 10-wpm ranges; for a par 


ға a 

с orsons fj. 

T Ae я + selected 21 person с! 
а These are based on a randomly sele te 
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of 42 Ss ee an equal frequency sample 
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5108 wpy Meg (9-24, 25-49, 50-74 
т ш) саке 
|. Within Rang one that used Condition X 
Siicant Cont as the error term—showed 
nar he pies х Range interaction (Р 

al-nonvisual ency toward narrowing 
: es in skill is eedback difierences with in- 
md with кс uncertain: it can 

Ding accor M but not with narrow, 
Beets g to skill range. 


hy» Of Wor 
Үр, ^ aye 
ors ork Conditions on Speed and 


sult 
ble a. аге 
er prese i 

едас sors (those щей in turn for appli- 
Ajay; ); total erro amenable to kinesthetic 
for ble hon rs, and speed. 
LA skill range Applicable error means 
ate gy, Veen visual and differences in means 
ie in able = nonvisual conditions 
фа Саб s 

1 Se errors " 

With faa noe is apparent from com- 
е ton LU data (Table 3), made 
3 dis s amenabl of all errors; most typing 

iho kinesthetic feedback. 
is уык , visual deprivation was 
WESA ta ee 
аусар -hanq rs. Specifically, the ex- 
ith atio colum ^ 
oY Тер п of typi n of Table 2 suggests 
GE to ioe into three groups 
Susceptible e of visual deprivation 
lative to kinesthetic feedback: 
hart on typists at 9-24- 
dy 5 and aas effects оп 25-84- 
ҢҮ Nontrivial) narkedly smaller (but 
S a lysis effects on 85-108-wpm 
he pn 07 Varia 
Мечо Section П for applicable error 
int tees К analys I of Table 1. As with 
for dele of Section Т, condition 
е ah саша errors were highly 
iie on. of significant range 
Sensi a is implicit in the 
fiu = character of the dif- 
Fee means for those across 
"and n range mentioned earlier 
otal ке ОШ of Table 2). 
titler rors. Means for speed ап 
d de of the three work 
vis, ences between means for 
Sual work conditions at 
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TABLE 3 
SPEED AND TOTAL-ERROR MEANS U 
Work CONDITIONS AND ERROR ІХС 
UNDER NONVISUAL CONDITION 


Condi- | Err 


tion 3: 


7 7 
| Condi- | Condi- 
tion 1: 


tion 2: 


Variable 


Normal | with re- No. % 
typing | typing | “2 

Spe Я 5 | 

Speed (wpm) | 3030 | 3530 

рева Errors | 39.27 | 25.74 1510 | 14.36 | 55:8 


Note.—N = 189. 
shown in Table 3 for the equal-frequency 


sample of 189 Ss. 
Although total error means for each of the 


10 ranges individually are not shown in 
Table 3, they paralleled in trend those for 


applicable errors sho 
percentage of increase 
nonvisual conditions 
for 9-14-wpm typists dow: 
increase for 85-108-wpm 
ing speed, the 1.04-wpm decrement covers 
differences for each of the 10 individual skill 
levels ranging from —-48 to 3.43 wpm. 
Analysis of variance for total errors is 
shown in Section IIT of Table 1. Following 
significant overall conditions 
were found to lie be- 
between Con- 
). The reduction in 
instructions to Te- 


wn in Table 2, as did the 
in total errors under 
(e.g. 114% increase 
n through a 30% 
typists). Concern- 


eed is shown in 
is apparent from the 
able 3 that instruc- 
had a larger (negative) effect 
did deprivation of vision. Thus, 
e finding of significant overall 


conditions effects (Table 1, Section IV), sig- 
ces were found between Con- 


nificant differen 
2 and between Conditions 1 


on spee 
following th 


ditions 1 ап 
and 3 < 1001), but not between Соп- 
ditions 2 and 3. 
C orrelational Evidence 

Pertinent correlational data are in sub- 
stantial agreement with and therefore support 
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the early data on means. For the equal- 
frequency subsample of 189 Ss, 7 = .36 was 
found between typing skill (gross wpm under 
normal work conditions) and percentage of 
dependable nonvisual feedback (Condition 
3). There was not any strong tendency for 
continuous increase in dependable kinesthetic 
feedback as typing skill increased. The sharp 
effects of visual deprivation at very low skill 
levels and the modest increase in kinesthetic 
dependability among the very fastest typists 
were swamped by the general absence of 
differences in effects of visual deprivation 
among typists in the great middle range of 
25-94-wpm speeds. Another factor (as 
shown by the SDs in Figure 2) was the 
overlap in levels of dependable feedback be- 
tween skill levels. Finally, ғ = .39 was found 
for percentage of dependable feedback be- 
tween Conditions 2 and 3. The modest size 
of this r (in terms of 7?) Suggests the sub- 
stantial independence of kinesthetic feedback 
from the other components of all-senses feed- 


back (mainly visual, but occasionally tactile 
and auditory). 


Implications for Т, raining 


The results of this study call into question 
the conventional insistence on "touch" type- 


writing from the start of learning and E 
gest the desirability of free use of vision К. 
in learning to typewrite: as guidance E 
making responses, as a source of corrective \ 
formation for wrong responses and of ! | 
mediate reinforcement for correct respons 
and as a reducer of the anxieties and tens у 
that reportedly commonly accompany E 
insistence on nonvisual work. 
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IVIDUAL RESPONSES AND SOCIAL DESIRABILITY 
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Michigan State University 


Several i WE 
ace investigations indicate that, for th 
y inventory items has only a low t 


e average S, endorsement of per- 
o moderate correlation with social 


desirability : 
s ility (SD), unlike the case when probability of endorsement by a group 


is 
related to desirability. 


These studies 


for the indivi 
е individual and the product-moment сое 


single S’ 

АШУ d responses are analyzed in a way the 
ability а endorsement, the product-moment correlati 
i and SD typically is high, approaching much 


igh ау cd n 
verage individual correlation between endorsei 
discriminating between disparate groups. 


Not pr А 
Prevent a diagnostic scale from 


As 
Ше а gene 
йер 0 Pd nk the probability that 
depen Огу item р will endorse a personality 
inr rating мш gy чыш D 
to eh of the "m of the social desirability 
Чү Ле With ет. Yet the picture appears 
NM Subject responses and ratings of in- 
aq 5» ап ea (Ss). Despite differences in 
gan (Тор ев, Taylor (1959), Boe 
MUS a Block (1965), and Ed- 
Wo x" dh То endorsement-SD cor- 
Чең ШШ have Ower in individuals than in 
Bite. ihe та да Point-biserial coeffi- 
Ween for ndividual and the product- 
group results leads 
On 25 he use of a solitary coeffi- 
n its E ii i data clearly is er- 
Vid аа as to the potency 
Ча] case ng item endorsements in 
Taylor ip. 75]." Boe and Kogan, 
investi ch а similar conclusion. 
еа have had to con- 
iar factors as contribut- 
ptis Norge (a) unreliability of 
Op S of Tseme ger 
Kan’ ап. the рој nts, and (b) limiting 
А indi Kogan Oint-biserial coefficient. 
Men Otte Vidua (1963) found by retest 2 
jp aep быр ү, Phdorsement reliability 0 
a on сан individual endorse- 
to P3 attenuation raise 
nt. :32, compared to а · 
qi My theip gai endorsement-SD ol 
ёо, be udy are lower than usua 
tj, tems q Use the SD values of their 
of у, late widely from the total 


PI SD values.) 


closer to the group value. 
ment and desirability does 


Taylor (1959) briefly, and Block (1965) 
more fully, treated the reliability question 
hypothetically. Taylor estimated mean in- 
dividual endorsement reliability as .60, a 
value that now appears low, and calculated 
the mean individual endorsement-SD cor- 
relation of .39 in his study would rise to .60 
if unreliability were removed. Block con- 
sidered individual endorsements highly reli- 
able, citing Goldberg and Rorer’s (1963) 
finding of about 85% mean individual re- 
test consistency Оп the MMPI. Simple com- 
putations pear out Block’s conclusion that 
the difference between his mean individual 
coefficients, which approximate 54 in five dif- 
ferent samples, and corresponding group 
coefficients, which average near .81, cannot 
be attributed to attenuation, for when "true" 
and “false” responses of an individual S split 
40/60 (or vice versa), 85% consistency of 
response yields a tetrachoric correlation of 

{ and retest. For true/ 


around .86 between tes 
false splits between 30/70 and 50/50, the 
correlation must be similarly high to produce 


onse consistency. Since Block used 
a T hich Messick and Jackson (1961) 
rrelate .06 with a separate set 
unreliability either in en- 
SD cannot account for the 
individual and group coefficients. 
d methodological problem, limit- 
istics of the point-biserial, is 
Block (1965) and Edwards 
ock pointed out that 


developed earli 


The secon! 
ing character 


treate 
(1965). Bl 


Point-biserial ys, although product-moment co- 
efficients, all on a more compressed scale than 
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product-moment rs based solely on continuous vari- 


ables Moreover, biserial coefficients are further 
B aiu "ыйы * H “ щи. 
lowered ап individual's proportions of “trues 
and “falses” deviates from 50-50 [p. 76]. 


Edwards developed further the consequences 
of these aspects of the point-biserial; if an 
S gave the socially desirable response to each 
of the items used by Boe and Kogan (1963), 
the point-biserial correlation between endorse- 
ment and SD would be .81, not 1.00. Making 
an additional assumption about the negligi- 
bility of small differences between ratings 
that fall within the neutral sector of the SD 
scale, Edwards calculated that the maximum 
possible individual coefficient for Boe and 
Kogan’s items is approximately .62. It seems 
quite clear that comparisons of point-biserial 
and product-moment coefficients in the pre- 
sent application must typically show wide 
discrepancies, 

Fortunately, it is feasible to assess the 
endorsement-SD relation in the individual $ 
by a product-moment coefficient. Giving up 
some precision in measuring SD—precision 
that may be superfluous in most practical 
instances —makes it possible to use a single 
S’s responses to Subsets of items, each subset 
relatively homogeneous in SD, to compute a 
more reliable estimate of probability of en- 
dorsement than is provided by single item 
data. Consider, for example, the case where 
SD values of items range between 1.00 and 
9.00, as in the Messick and Jackson (1961) 
norms for the MMPI. АП items with SD 
values between 1.00 and 2.00 can be pooled, 
and probability of endorsement calculated 
Írom an individual's responses to the pool. 
The same can be done with items falling be- 
tween 2.00 and 3.00 on the SD scale, and 
50 on for the remainder. The pools arrived 
at in this manner, however, need further 
Subdivision into Subscales of equal length if: 
(а) each point on the scattergram relating 
endorsement and SD is to be based on the 
same number of items, and (5) the scatter- 
gram is to have enough points to be roughly 
comparable to the plot obtained when group 
endorsement is related to SD for each item. 

The following use of this alternative 
method shows that the tendency of in. 
dividuals to give socially desirable responses 
to MMPI items is much closer to that pre- 
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vailing for the group than earlier B 
tions have found with point-biserial M 
cients. Because Ss in this demonstra 
come from dissimilar groups, it also a 
information regarding the proposition e 
high individual endorsement-SD айн 
prevent discrimination by diagnostic 5 


METHOD 


i loy: 

To simplify scoring, the demonstration э igi 
the first 300 items on the standard ee пай i 
answer sheet. Items first were groupe! ? qesirabili 
Messick and Jackson norms, into ach ‚ ТЎ 
classes: 1.00-1.99, 200-2909,..., Eo ^ mod? , 
grouping gives a skew distribution, siderations © 
the category 3.00-3.99, Practical consi er ais d 
the length of the subscales; subscales 2 vad os 
each used most of the items and minim ùl sal 
at the extremes of the SD dimension. 5 k 
preserved the order in which items E pook! 
MMPI booklet; for example, the m 1. Й 
items with SD values between 1.00 m second " 
up the first subscale at the level the more i 
the second subscale, and so on until no А Í б 
could be formed at that SD level. elative a 
Procedure yielded 46 subscales, each Т ета}: T 
mogeneous in SD, for a total of 209, "a 
items constitute the majority of ое оу p 
standard MMPI scales, and probably ir s a Р 
extreme SD values than the inventon i $5 i 

abill? j 
cause every subscale had six items, pror rg ш 
endorsement could be represented ЪУ (r9 7, 
items endorsed per scale. For cach 
ing from 0 to 6) on the 46 subsca ni with | 
related by the product-moment pon same i 
SD levels (ranging from 1 to 8). Toon. Fit 
Were analyzed by point-biserial correla probal E) 
responses pooled across Ss gave ШОШ with d 
of endorsement, which then was correla the gro 
In all instances, SD was represented pm 0 Du 
values, а procedure that kept errors, a neth! d 
ness of grouping, constant over all pu tw? gd E 

Subjecis. MMPI protocols came 0 male ш, 
parate groups. First were those of s4 à 
graduates in introductory psychology К 
State University in 1954, collected n convicts 
Study. Second were 30 protocols oP am 
routine testing upon entry into South "m 
Prison in 1959, 

Results. Analysis of responses by arlie 
coefficients gives results like those in а i 
For students, point biserials ranged fro n 

Е Я 5 2 3. 
with а mean (computed by Fisher was “ 
tion) of .51. The group саган | 4° 
prisoners, point biserials ranged from - ome 
a mean of 46; the group product-m re or? 
cient again was 93. As expected, Le and 
discrepancies between apparent indivi spo se 
tendencies to give socially desirable IC 
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Th 


„these di; а 
dividual discrepancies are much narrower with in- 
Individual eee correlations. For students 
ean of ае ranged from .38 to .91 with 
Tom 30 to 90 Coefficients for prisoners ranged 
icipated, & With a mean oí .77. As might be 
n higher hag ee moment coefficient always 
serial coeffici the corresponding point-biserial. 
D Cents fell between the other two 

аз Studies 
cals me to the expectation that the 
Mee men, [эбен higher Pd scores than the 
tus Beater qj ng the 30 prisoners, 27 had T 
8 men, thie p 70, as compared to 3 of the 
Uncorrected being true both for K-corrected 
ed Nt validit Scores, Contrasted to this high 
У for the Pd scale, the individual 


lots 
lap p ments 
in co i 
the two mer almost completely over- 
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-bise " . 
dors, me for the present Ss 
Уйан 25% of individual en- 
oduct-m is associated with SD, 
609; oment method of analysis 
s e tenden 15 а more likely figure. 
Whe ent sam Cy of individuals in these 
Ste as soci ples to give answers judged 
Wea) we desirable is strong rather 
eap. Dy rn these responses, when 
Out the Sani point-biserial coefficient, 
studies e apparent relation to SD 
Chnique к ported from use of а 
5 te pepe _ ame 
n ei eni 0 
aegis де пип 
ш peal indio dorsement. correlation in 
Om gar m UB protocol does not pre- 
ninating ty diagnostic scale, Pd, 
е € etween prison and col- 
veikon., discussions of SD and 
if m sometimes have seemed 
NLIS th tea à correlates highly with 
i ың osti is no point to the use 0 
Parate 1С scales; or, contrariwise, 
diagnostic scales are valid, 
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there cannot be a high correlati 

endorsement and SD in individuals. p 
from the present study show plainly that : 
strong association between individual idee 
ment and SD can exist alongside of high co А 
current validity for a diagnostic scale, a and. 
ing consistent with a recent study by Wahler 
(1965) demonstrating that reliable item pret: 
erences distinguish groups when the effects of 
SD are partialed out. E 

Neither exaggerating nor underestimatin 

the presence of SD in personality E, 
serves a useful purpose. The relation of en- 
dorsement to SD has basic interest apart 
from the fact that it occurs in inventories 
originally designed for applied purposes. If 
practical considerations are the center of in- 
terest, then SD surely is involved in the 
design of suppressor scales and of disguised 


or “subtle” items. 
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ORDER EFFECTS IN ASSESSMENT DECISIONS ' 


PATRICIA M. ROWE 
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ments of people. 3 groups 
containing varying 


of 25 Ss each judged descriptions of individuals 
E bi 4 ives. 3 
Proportions of favorable and unfavorable adjectives. 


Б атт ch 
orders of presentation were used: ascending (all unfavorable adjectives throug 


to all favorable), descending, 


and random. 


More descriptions were accepted 


li i i a a: e. Г T of 
with the ascending order than with the descending order. Furthermore, orde 


presentation significantly 


affected individual differences in category width. 


The results were interpreted in terms of assimilation and contrast notions. 


Most of the personnel-selection literature 
treats an assessment decision as if it were 
a single, isolated judgment. Vet most selection 
decisions, whether they concern job applicants 
or candidates for graduate work, are made in 
the context of previous, similar judgments. 
There is a wide variety of possible contextual 
effects on decisions: the type 
previous judgments, the time interval be- 
tween judgments, and the order in which 
judgments are made, to mention only a few. 
In a study examining the effect of one judg- 
ment on the following judgment, Holmes 
and Berkowitz (1961) found that an in- 
dividual was judged more favorably when he 
WaS preceded by an extremely unfriendly 
Stimulus person than when he was preceded 
by a very friendly stimulus person. The pres- 
ent investigation is concerned with the effects 
of making a series of judgments on an ordered 
arrày of stimulus persons. Simply put, the 
question here is whether decisions are differ- 
entially influenced if one happens to judge 
applicants in order from best to worst, or 
from worst to best. 

Many previous studies of judgments about 
People have been Concerned not with the 
ordering of individuals, but rather with the 
Ordering of characteristics within a single 
individual. Under these latter conditions, 
studies by Anderson and Barrios (1961), 
Bolster and Springbett (1961), and Luchins 
(1957) have demonstrated primacy effects: 


and number of 


1This study was Supported by Defence Research 
Board of Canada Grant No. 9425-10 to D. Bindra 
of McGill University and Grant No. 9401-27 to the 
writer. Thanks are due to M. P, Bryden for his 
many helpful comments. 
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ve? 
the characteristics presented frst М n 
greater effect on the total impress! геге 
individual than do characteristics БЕ hi! 
later. Berkowitz (1960) has AE sini 
such primacy effects are due to ше jer it 
tion of later material into the d i P 
pression. Assimilation occurs lane 9 jid 
characteristics belong to the same gm a 
(i.e., the psychological distance r3 how" i 
and late materials is small). T^ ili! 
subjects (Ss) recognize the incompaU ydi 


This study was concerned with the effects of order of presentation on judg- 


: gic?” qw V 
the two sets of material, the psycholog T 


Mi. к псу € E of! 
tance is increased, and a recency dition ©, 
to contrast is likely. Under the pp jdu? 
systematically ordered group of = айе 
where the sets of material appear pec Y 
individuals, judgments would be € a ^ 
Show the effects of contrast. Tas пе Ж 
Should be judged more favorably v. ws 
ceded by a less likable person Du: ой 
preceded by a more likable раа к 
prediction is identical to the one dap?" 
be made from Helson's (1964) P how 50" 
level theory, and has already wi “ш 
plicable to psychophysical judgme 
& Nash, 1960). 1 
Because judgments of other m і 
regarded as а categorizing prove егеп y 
necessary to consider individual how? "i 
categorization. The writer has es, cU yp! 
one type of individual шеген сей P gt 
width (the number of stimuli Ps id gm 
same category or class), exists acer 7d 
of people. When personnel. o af jo? 
judgments of written descriptions jste”! 
plicants they show large and pit 
ferences in the number of applica! une! 
(Rowe, 1963). Furthermore, 


ef 
тё Me 
is Tu 
Ж 


еа 


ORDER EFFECTS IN ASSESSMENT DECISIONS 


Tajfel 6 
i 19 h 
\ 1) ave demonstrated that in- 


divid 
ual diff 
erences in catego Б А 
gory width in а 


Ot-classify; 
, classify i i 
ying situation are related to sensi- 


цу to s 
stimuli, rera in sequentially presented 
ferences ТЕШЕ suggest that individual 
5 Systematic таво width may be affected 
ich will b ally ordered stimuli, a question 
e examined in the present study. 


METHOD 


Student, 
„dents in 

: roductor е tension (noncredit) section of 

and army sychology course at McGill Uni- 

Was mar аре, е served as Ss. The distribu- 

Popula table to n дна level in the sample 

oE th ; since n at found in the general adult 

ty ae Variable. differences as a function of 

е басса Were found, no further refer- 

s ee of the Ss will be made 

е tested. ` 


ч 299 adject; 
Nit," еу e tives was presented to 50 pilot 
е: nor favorable,” “unfavorable,” or 
th есе ") and sta Out of this set 
е » With th unfavorable (U) adjectives 
lie eet. Agreed s: restrictions that at least 90% 

agia Could п their ratings, and that апу 
p CCtive coexist in the same description 
7 е m "a antonym of any other 
Structed үзене of individuals 
in Ota] оғ 103 selecting six of these 

followi descriptions were СОП- 
aye ae each ng fashion: seven sets of 
А a ee Puy: set of each of the Type 
le ay 40 адар ross co 1F-5U, 
us мето Ctves, wl йени containing 
p liit of ui ranged is in each description the 
A ua] ye SF-3U i order. A sample 

15: 


Con, 


b it is 
"осе 7 Actless, ы tag dissatisfied, logical, 
ide Te apable. 
o tra, 08 
Orde стр 
TS ons were arranged in three 


3 
the 10 Pay Вог 
al 5 

Ае Say script ре, a Ss the first 30 descriptions, 
ta tw for 1005, а те the same. Similarly, the 
hr timeni l Ss. pain of the 3F-3U type were 
y tibio irai 0и 31-03 constituted 
Мб; the T8 31. nt. In the ascending 
rne "tine туз? were of the 6U type, fol- 
qu (Dy ће Ty, 1F-5U descriptions, and 50 

Order ре 6F descriptions. In the 
Уре бр Е experimental treatment 
те” descriptions and finished wig 

е random (В) order €? 


by 
ооу, 19 f E 
ш ks, m Of онер n descriptions containe 
beq ihe 3 as Уре randomly arrange 
est escriptions were presented to 


ook $ 
Oklets without any divisions 
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between the initial set (Descripti 4 
experimental set (Descriptions cw comte iss 
set (Descriptions 94-103). Previous wok e nal 
that, from the point of view of decision рг onig 
there is great similarity in judgments Fi фсе, 
are asked to make decisions about job а dal Ss 
prospective roommates, or friends. FK ied 
more realistic for Ss in this study, their iu 10 was 
read each description, decide whether th Was to 
like to have this person as a friend. ey would 
check mark in the appropriate m puma place a 
description. The Ss were instructed To аы. "the 
description in turn, starting with the ar: засц 
tion, and make their decision before going SRED 
the next description. gomg on to 

The score for the various parts of the questi 
naire was the number of “like” judgments. ша 
each S was scored for the frequency of his tie 
responses ОП the initial set, the final set, and pe 
cach of the seven types of experimental Чеди 

Since a previous study (Rowe, 1963) had found 
large individual differences in judgments of this 
ary to equate the three groups in 
ber of like judgments. The 
descriptions was used for this 
purpose. Afte ng seven Ss, the mean number 
of like responses for the three orders on Descriptions 
1-30 were: A, 1 
standard deviations were: A 
nber of Ss per order was 25: 


The пип 
RzsuLTS AND DISCUSSION 

The effects of order of presentation on the 

number of like decisions can be seen in 

Figure 1. Observe that with Order А more 

d than with Order R 


descriptions are like 
through most of the experimental treatment, 
ith Order D fewer descriptions 


n with Order R. These data 
d to an analysis of variance 


o Ascending 
a Descending 
о Random 


ю o A O O - фо о 


Nea m 
n number "like" responses 


о 1 2 3 4 5 6 
Number of favorable adjectives 

Fic. 1. Mean number of “like” responses as a 

avorable adjectives for the 


of number of f 


function 
ers of presentation. 


three ord 


172 Patricia М. Rowe 


" ей 
TABLE 1 Type 4F-2U produces а greater w | 
. Y ik han 
ANALYSIS OF VARIANCE OF LIKE RESPONSES the number of like responses Arte fro 
"ow Descriptions 31-93 addition of one favorable adj рей 
Type 2F-4U to Type 3F-3U. Thoug E 
Source df MS F the scope of the present paper, it P Шам? 
there is some maximum number o lior 
Between subjects > able traits permissible in a friend; d 8 
Оаа. 0) biéct 2 22 993 number, most individuals are гејес a 
Error between subjects : below it, most individuals are accep on orf 
Within subjects The significant interaction ane, 
Description type (D) б | 788.88 | 419.62** of presentation and type of ба M | 
5 ** " } 
о н subjects 5 ies - best be understood by харсе mt 
сас : ` The largest differences among the th ns, tht? 
* <.05. occur with the “medium” descripto n 
жк < .01. containing one ог more of both fav nt 
g 


a 
unfavorable adjectives. Though е effec 
ing might be due to ceiling and - by 
its similarity to results obtaine sif 


(Order х Type of Description, Lindquist, 
1953, mixed design Type I), the results of 
which appear in Table 1. The main effect of 
order of presentation is significant: the means 
of the A and D orders for Descriptions 31-93 
are significantly different from each other. 
Thus the earlier prediction has been con- 


Y i 
firmed— stimulus persons systematically or- center. Thus the significant interaction at 
dered in terms of a favorable-unfavorable : 


е & 
€ й : present study is probably due to th Pat 
dimension produce a contrast effect on judg- susceptibility of average persons 
ments of like or dislike of these persons. In 


(1953) and Hovland and Sherif t 
Bests a different interpretation. А aro 
investigators found that statemen 2 Я dil 
the center of attitude scales are mor ron w 
shifted than are statements farther 1°. qi 


ipti 
other words, if one first encounters an un- E ч purpose in presenting Рекс ai 
pleasant individual in a social situation he 94-103, all of Type 3F-3U, was to de “ts 
is more likely to regard an average person whether there are any long-term е d m 
favorably than if he first meets avery pleasant order of presentation, In Table 2 ЇЇ "m. 
individual. These results are also further percentage of possible like respon". 
confirmation for the notion that the underly- 

ing variable responsible for producing as- each of the three orders. From this amo" 
similation and contrast is that of psycholog- is clear that there are no difference? o; 
ical distance—the greater this distance, pro- the three orders on Descriptions 94— 
viding the stimuli are still on the same con- 


tinuum, the more likely is contrast. In the Т y 
$ ї ТАВІЕ 2 of 
present study, psychological distance was Menus ds С — PERCENTAG p 408 
great because the stimuli were separated MEANS AND CORRELATION 1-30 AND 

B ; pee RESPONSES ON DESCRIPTIONS 

into different individuals, and thus contrast 


AS A FUNCTION OF ORDER OF 

resulted, PRESENTATION p 

Type of description, of course, produced a p 
highly significant effect on the number of M percentages bet gif 
like decisions. Tt is perhaps of interest to De п 
note in Figure 1 that with all conditions, even Order Descriptions | Descriptions ori 
with Order R which is uncontaminated by 1-30 94-103 ғ 
order effects, the number of like judgments 30 
does not increase linearly with the number A 37.47 2M D 
of favorable adjectives. Most particularly, it D 35:40 R И 


R 35.87 35.60 
of one 


favorable adjective from Type 3F-3U to 


ORDER EFFE 
R EFFECTS IN ASSESSMENT DECISIONS 


is there 
an i 
y change in the percentage of like 


ecisions 
ough тна Descriptions 1-30 to 94-103 
© long-term results suggest that there ane 
Presentation group effects from order of 
01 whether » they do not answer the question 
ystematic stimulus orders affect 


Indivi 
nt Чы differences in decisi 
tions p ast ecision behavior. 


ivi —30 

Vidual differ and 94-103 are presented. 

ars uS in the number of like 

te с Al set - ат from the initial 

Sonsiderably rd the random order, but 

tor Ош orders юре under both the 
Gers. Moreover, the correlation 


frg Ue R is signi 
масте (b шу greater than that 
the en is а теһарр 5). It seems that category 
Thus dition or е phenomenon only under 
пау i: e ities р presented stimuli. 
iu е mee category width 
Pasja M assort iated with responsivity to 
ment of stimulus items. Ex- 


teng, 

S to Oas А 

ш һе: ange icon order of stimuli 

| otio icted by į responsivity in a direction 

"ing. a Would initial category width. Such 
Тай ы be incompatible with 

: is S (1961) suggestion that 

han E related to sensitivity to 


Nosna Of 
Ste, Sib thi 
im ut Rid йа HE not 
Y чү escriptio: out with live people in- 
one’s on) S Point 1s as stimuli (for a discus- 
the Cn tough st Webster, 1964, p. 72). 
ig Sele c evalu studies such as the present 
чү ten зш the effects of order in 
lig, Pesene a Tara Helle of previous 
Yaj, Of clear r ones are quite striking 
% nite, Cont evidence for the contribu- 
h ес, ether a to assessment-decision 
bij, Ве d for E ап individual is accepted 
М quar ctg gob may well depend more 
eunt а Shite tics of the previous ар" 
NI de & бш traits. Perhaps more 
Че Leg dereg pi ence concerning the et- 
esentations on individual 


le, 78 
р © E 
at ecisi, 
*Bory wide behavior. If one con- 
easi, or the number of like 
ure of an interviewer’s 
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stan 

Rupe do epo ы 
judgments about applicants с tat 
random order. Otherwise, if judgment: es i 
applicants are made sometimes in A akis 
order and sometimes in descending си 
the interviewer's standard of ассе {ап ies 
show gross fluctuations from M E 
session to another. TS 
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AN EMPIRICAL APPROACH TO CRITERION 


SPECIFICATION 


JAMES E. PALLETT ° 


Placement Center, University of Iowa 


{ GENERAL BUSINESS’ 


DONALD P. HOYT 


American College Testing Program 


The investigation sought to discover specific behavioral characteristics related 


to judgments of success in general business activities. 


Supervisory ratings of 


23 specific characteristics and of 2 overall measures of success were obtained 
for 230 University of Iowa graduates employed in nonspecialized aspects of 
business. All Ss had been out of college for 5-10 yr. Multiple-regression 
analyses showed that 13 of these ratings were sufficient to account for the 
entire set of variances and covariances; 8 of these 13 ratings made independent 
contributions to the prediction of overall ratings and were thus considered to be 
elements of success in general business. Implications were drawn for job 
recruitment, selection, guidance, and training. 


Most college students want to know “Do 
I have what it takes to be successful in this 
field or that field? If not, can I ‘improve’ 
myself so that I will be successful? How?” 
These questions are not much different than 
those asked by the recruiter of college talent. 
“Can this individual help us? In what di- 
vision can his talents best be employed? 
What type of training will benefit him?” 

The research reported in this paper seeks 
to define the elements of success in general 
(nontechnical) occupations in business. Its 
purpose is to describe relatively specific 
characteristics associated with a positive eval- 
uation by employers. 

Because different jobs require different 
skills, the study is limited to one type of 
employment, “general business.” Of concern 
is that group of college graduates for whom 
specific or technical academic backgrounds 
are irrelevant to their employment. This in- 
cludes graduates of business or liberal arts 
curricula whose employment in the business 
world bears little relationship to their college 
major. Examples include mathematics majors 
employed as office supervisors, political 
Science majors employed as advertisers, or 
general business majors employed as sales- 


1 This paper is based on the doctoral dissertation 
of the senior author (Pallett, 1965), done under the 
direction of the junior author. The project was sup- 
ported in part by a grant-in-aid from the Research 
Committee of the Midwest College Placement As- 
sociation. 

? Now at the University Placement Service, Uni- 
versity of Wisconsin, Milwaukee. 


men. Excluded were such groups а ae 
majors working as commerical p e i 
counting majors working as accou jare 
mathematics majors working а5 actu 


SAMPLE i 


L 

come” uj 

The sample was chosen from the Dos of ү 
of seniors registered at the СЕМА pet" ji 
Business and Industrial Placement ні сое 
1954 and 1959. АП had been out í 
from 5 to 10 years. ts 200и 
Random samples of 250 liberal аг were Ds 


business administration male registran indi" 


Írom these placement lists. These der {0 Ky 

were then contacted by postcard in ort and у 

the nature of their present employ™ sup al 

name and address of their immediat gt 

They were also asked if they had pur?" 1 o 

work. urne up 
A total of 415 of the 500 Ss (83%) pur К 

ү} 


pleted postcards. Of these, 206 were z mini’ 
arts sample and 209 in the business ? 
sample. А 

The Ss were excluded for the followin $ ed 
employed in a specialized job which 
academic training; earned an асу 
employed in government, education; A 
profit setting; self-employed or employ sa 
business. These exclusions reduced the 4 
to 256 (103 liberal arts graduates a" 
administration graduates). 

Immediate supervisors of these 
were asked to supply ratings on qu o 
below. Returns were received for e E th 
arts graduates (81%) and for 138 = 
administration graduates (90%). Thes 
stituted the basic sample. 


0! 


256 
lities | 


MEASUREMENT "T 
such” rV 
To establish the general measure of up? 
these college graduates had attaine® 
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CRITERION SPECIFICATION IN BUSINESS 
17 


Were aski 
ed to x 
bius ara сае fheir “preges Edy 
eee potential” гор (advancement 
hs абод to others a (anticipated advancement) 
: те. Ratin; of similar age, experience, and 
Шр о АЕ латаи 
ds rom “lowest 202" on a 7-point scale 
aby Wo ratings we 2%” to “highest 2%.” While 
ing, both were P expected to overlap consider- 
i duals Wau oe on the chance that some 
pag, tits While о rapidly and soon reach 
lis ally but БЫА. ers would be "brought along" 
"ty high | promise for eventual promoti 
lieyeg 255095 сац posts ОРЕ 
ed [4 e 
tating ? represent aspects of su characteristics be- 
Mets cales were of success, a series of 23 
Чеп represent, constructed. These 23 char- 
Mention, овоа а synthesis of specific char- 
Super ed y ee in industry,’ or commonly 
Dickens rites, ei psychologists (Super, 1957; 
itis vee 1955; John and placement specialists 
eal wir named Ad son, 1959). The character- 
Rent d Abstracts ана Creativity, Ability to 
du wig Sieht, Dici roblem-Solving Ability, Judg- 
je aS the buie ы Accuracy, ldentifica- 
esos De s World, Identification with 
суйе, ЖШ аы DIE Self-improvement, 
КЫ Poise s, Sensitivity to Others, Lik- 
ttp, i cation,” Admini i | 
Я 1 ion, Oral ыш Ability, Written 
drive). p ommunication, Leadership, 
ies ch - ; Persuasiveness, and Competi- 
‚рн "Cale А 
Stic, gr OF be esten of three statements de 
ior a 
tent moe to a given character- 
4 ы p favorable (scored 2), one 
is AES unfavorable (scored 0). 
a he ae set were arranged in 
агреп the ocus on behavior was in- 
e тев ore of the variables and 
s Two ex ity of ratings (Thorndike & 
Xamples are given below: * 


h n 
mtra ( State; 


Order 


‚ үү еп to 
V са mak isi В 
& is nec О SO. 

Re table to da ГУ for him to make а decision, 
vacil with only ordinary qualms. 
cision fe a great deal when faced 

hat he must make. 


kes 
N RIOT 
B e) 

«М р 
i li 
a des pug for his work. 

Wi ed in his work that he fre- 


of Carries TES overti 
p 9n his E time voluntarily. 
h а duties with a normal amount 


enthusiasm. 


P for 
маар An оне, ‘The Maytag Com 
Ej, e erican шы Caterpillar Tractor 
S m ospital Supply Corporation; 
uck Pany, Ford Motor Company, 
the the ты Company. 
Senior Bee set of scales аге avail- 
Or. 


pom 


PROCEDURE 


guided isti = 
determine if fewer bed y ye decor (1) To 
io represent the ИШТЕ: of s could be used 
of performance in general buan амон descriptive 
To determine which of the 23 e pens 0) 
dependent contributions to the predi ings made d 
success and thus could be odds dm Of overall 
n in general business. гей ашшы" af 

A factor-analytic approach м Я 
rejected, for reasons -— hp ie cna but 
Briefly, the factor approach involved Ше, 
culties. (а) In the present study, there a Ces 
status difference between the overall crit ios 
ratings (dependent variables) and the specific _ time 
(which could be treated as either dependent of = 
bles). Factor analysis is poorly suited 
to problems where such status differences exist. (b 
It seemed unlikely that the data of this е 
tion could satisfy the rigorous conditions тесш са 
before factor-analysis techniques can usefully be 
employed to provide objective definitions. (с) 
Factor-analytic procedures have been regarded tradi- 
tionally as appropriate to exploratory or confirmatory 
purposes, but not to definitional purposes such as 
those guiding the present investigation. 

The multiple-regression model obviates these diffi- 
culties and thus was chosen as à more appropriate 
approach to the problem.® The procedure 9 required 


selecting à few of the specific scales a5 independent 


variables, and treating all remaining scales as 
ix №. prepared of 


dependent variables. Then а matr 
ong the dependent 


Two goals 


dependent varial 


all remaining dependent variables. 
is given by 


4 iate statistical test is E Anderson 
(1958) for determining if the artial correlations, as 
š is, the statistical hy- 


rtial correlations are in- 


a set, 
pothesis is 
dependent. 

Assuming that a 


could be foun 


ndent variables 
hypothesis was 
ine which of 
ributions to 
variables 


set of indepe 


that this 
o determi 


business. 


RESULTS 
Intercorrelations among the 23 specific 
two overall ratings are shown 


ratings and the 

in Table 1. 

are indebted to Harold Bechtoldt 

for providing suggestions regarding statistical anal- 
available an appropriate com- 

ko due to Bill Snider 


Thanks are al: 
Computer Center for 


ogram. 

puter Prov versity of Towa 

lysis services. 

6A more detailed statement of the procedures is 
toldt, Benton, and Fogel (1962). 
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CRITE 
ITERION SPECIFICATION IN BUSINESS 


This t: 
n able W; а 
18] аз ех ; = 
xd Scales to etur gne to; identify prom- 
El» Five Seale Ah deii aim 
clusters" were i i 
таб, е scale with th dem were identified, 
ation with; e highest median inter- 
ersuasi ithin the cluster 
asiveness cluster was selected 
zi ification wi Foresight, Dependability, 
ableness en the Business World and 
bos Scales Or chosen on this basis. Three 
mo nication tal Communication, Written 
con ty — were т Identification with the 
ratings ions vilih ; озеп because of their low 
5 Were use ua other scales. Thus eight 
ха dal corre] as independent variables. 
Varig Were cor ations among the remaining 
les held mputed with the independent 
7 Was m While the median 
Exceeded V AES, 27% of the 105 
€nce of уем Тһе hypothesis of 
le 2 :09, df= A arse r’s was rejected 
M ae tht indep 36, p « 01). 
e s 
| 5 With ien variables correlated 
пф. Pectively [ae and “Potential” 
variables ut seven of the other 
оге ЫШ had partial correlations 
ots hh быар these two criteria. 
tease the PM to effect further reduc- 
хиа, p tipo ae and to in- 
piles = Ot these ions with the overall 
ает, Кт о three additional 
i АМ bec Ving Ab n independent variables: 
s the саше they i and Leadership were 
мааа pd crit ad partial /'s of 20—24 
: because e Sensitivity to Others 
ing in pendent . several high partials 
s variables. 
wl а "E independent variables, 
la] pendent above was repeated for 
relation w variables. The median 
Bis as reduced to .035; how- 
б ау still exceeded 2.15. 
Wo d Cory IE of independence among 
% оа elatio. B 2 
БУ ns was rejected (х = 
е Me. Ot). | 
те зб Rs with “Progress” and 
crea 
tw Seale Partial sed to 74 and .71, 
\ NA E 5 with correlations of three 
ii htc 5. Two these overall ratings Still 
Si he these three— Creativity 
lve)—Nw d- 
n ere chosen аз 2 
the i variables. 
ysis was repeated using 13 


(es 


oft 


TABLE 2 


ADEQUACY А UNTING 
жы or 13 Specific RATINGS IN Acco! 
ron 10 OTHER RATINGS OF JOB PERFORMAN ез 
F ANCE 


Dependent Number of | Partial r* | Parti 
ккк [Г-И with o й 
above .15 | “progress” | “potential” 
Adaptability 1 17 
Ability to deal H 
with abstracts 0 
Judgment 0 E 06 
Decisiveness 1 10 01 
Accuracy 0 02 01 
Self-improve- u 
ment 1 —02 
Interpersonal € 
relations 0 —10 —05 
Poise 1 07 05 
Administrative 
ability 0 01 07 
Competitiveness 2 06 —01 


а Decimals omitted. 


nd 12 dependent vari- 
ependence among 
s again rejected 


independent 
ables, the hypothesis of ind 
the partial correl 
(х = 149.87, df= 
the median partial corr 
to .021, and only 796 of the partials exceeded 
+15, Further, no partial 
“potential” ratings was as 
only one partial with “р 
reached that level. The mu 
these overall criteria were 


respectively. 
An examination of the 
partial correlations suggeste' 
othesis of independence may 
the basis of 
“progress” and “poten- 
o check this possibility, these 
mmed and treated as à 
When the analysis was 
the hypothesis of in- 
x = 61.26, df = 
50). It was concluded that ratings 
? and “potential” were too closely 
efully as separate criteria. 
les were taken as the best rep- 
of “job performance in general 
» which could be made from this 
ounting for the 


fic scales is reviewed in Table 2. 


75 and .72, 


entire matrix of 
d that the hy- 


of “р 
related to serve us 
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TABL 


Beta WEIGHTS AND. MULTIPLE Corre. 


ЕЗ 


ATIONS FOR PREDICTING 11 RATINGS OF 


Jos PERFORMANCE FROM 13 OTHER RATINGS 


MÀ ———— 
Е Beta weights? for predictors? E 
Dependent variables | 1 7 d 2 | 13 | 
E 12 (2a lade ЕЕ [9 |10| 1 j1) —[Д 
| | | М 
Adaptability 36 | | 15 | 24 8 
Ability to deal with " —18| 19 | 26 5 
abstracts ч 3 
Judgment 22 24 " 18 16 | 15 Е) 
Decisiveness 20 | _ 2 17 3 
Accuracy 34 15 E 20 6 
Self-improvement 22 16 17 m i E 
Interpersonal relations 14 29 13 {8 | 
Poise 26 19 | 18 16! 28 „|8 
Administrative ability 17 16 15 , 25 25 
Competitiveness 24 18 4 " f 
m К 13 
Overall measure 17 13 | 16 | 21 | 17 14 
a ima itted. EM itiyity to others 
D Геба атыгат 6 = Written communication 10 шне 
2 = Identification with the business world 7 = Oral communication 11 T "T 
3 — Identification with the company 8 = Persi veness i | usiasm (drive 
42 Dependability 9 = Problem-solving ability ше 
= Likable e ze 
e M iei iion with those predictors whose beta weights were significantly different from zero. jl 
res 
The 
This table shows that the partial correlations betas were significant (p = 05) Ё d 
among all dependent variables, including the are summarized in Table 3. ; that “а 
two overall ratings, were low and generally From Table 3, it can be seer 


not significantly different from zero, 

A step-wise multiple-regression procedure 
was then followed using the 13 Specific scales 
as predictors of each remaining scale and of 
the combined "progress" and “potential” 
scales. Predictors with nonsignificant beta 
weights were eliminated, one by one, until all 


TABLE 4 


ELEMENTS oF Success IN GENERAL 
BUSINESS ACTIVITIES 


9 Уагіапсе 
Element egi ts ra contribution 
(b Xr) 
Persuasiveness UT -56 | .118 
Identification with 
the business world 171 54 |.092 
Problem-solving 
ability 166 «48 |.080 
Leadership. 137 -53 |.073 
Oral communication 159 43 | 068 
s ity 132 -51 |1067 
sm (drive) .120 444 |.053 
Identification with 
the company 427 35 | 044 
595 = К; R = 7] 


* Single-order correlation with overall criterion, 


Р ! 
. ried “ре? 
the 13 independent variables car t 


] 

+ H H era ш 

one significant beta weight. к mor i 

were useful in predicting five 0 g 

dependent variables. sth indep” al 
Eight of the scales ша 


: ne O° ie 
contributions to the prediction d a Pal 
criterion. These eight scales are cess int. 
elements or factors describing вис chen jn 
eral business. Table 4 identifies pred" 
describes their relative potency 10 


overall success. 


DISCUSSION e 

Several limitations should be ar of os 
Results were obtained from ШАШ 10 > ar 
one university who had from 5 » was eu 
postgraduate experience. wa of jl 
ated solely from the employer's P B wa uf 
The reliability of the rating er Ў, 
known, and it was necessary to em ito, 7 
rater and intercompany сотр d гап? gi 
nally, it is probable that a n oss! 
"success" was assessed since 


CRITE 
ITERION SPECIFICATION IN BUSINESS 


ures” 
would bi 
Т по е 
t expected to remain in 


usines 
B 5 for 5 
or more years, These limita- 


tions 
‚15 provid 
s e the framework for the follow- 


Ing discussion 
Eight factor 

ie jobs Persuasi overall success in busi- 
"E Usiness ы Identification with 
місні, Oral "d Problem-Solving Ability 
Usiasm (driy, ommunication, Creativity; 
tih Ompany R е), and Identification with 
d, with a on these factors cor- 
lin at the DA criterion. It seems 
measu ranges of b nknown reliabilities and 
oth predictor and criterion 


Cite S ас 
erg, A CCount 
variance for most of the remaining 


thee uela] : 
"— eight басы “Did these Ss possess 
Othe at the Cteristics in the same relative 
Perie е, to llis, of graduation?" Put 
e бавын modifi - 
tang teollege сз? If ake do 
Ss ne affecteq experience has not sienifi 
ИШ] ; ese = relative standing of the 
айза], Well aracteristics, then recruiters 
ha! ptio on es а to concentrate their 
gt з un а The basic 
i ote evaluated in BIS: recommendation 
the ) the settings this setting; studies 
NE ort it in rs 1957; Astin, 

hat they have shown 


initi 
acteristics i measures of these 
much more than any 


iron 

Ment, 
al m 
and or treatment conditions. 
d find 


1 
MES thei 
edi ts to eir counselors shoul 


pen: 
and des. both to the need for 
al anal е necessity for applying 

y ° Question е in their absence. 
Such pi be raised of the 
lona] DE to train- 
i lacki Репенсез, Сап students 
ample ‘iy in problem-solving 
, be advised to take certain 


піс 
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courses or gain certai i 
prove these ue me umb A 
unanswered question. The iri cim 
ear yen to earlier suggest et 
m e safer to identify students ке 
ien : ает the desired тагыш эм 
ve provide remedial programs for tl 
ive nots. But it would seem worth ^N 
to investigate hypotheses such as the Aem 
ing: Courses in mathematics and Toate a 
velop problem-solving skills; oie те 
participation develops leadership; spe 
courses. and part-time sales jobs id 
persuasiveness; writing and art courses ra 
velop creativity. m 
. Job performance Was described by th 
eight elements of job success plus дуо au 
foresight, dependability, 


ditional elements: 
likableness, sensitivity to others, and written 
communication. College graduates employed 


in general business activities can be differ- 
entiated by these five performance attributes 
but this differentiation does not contribute 
to an assessment of their job success when 
the other eight performances have been taken 
into account. When an employee is described 
as “dependable,” “likable,” etc., some aspect 
of his performance is being described which 
is not redundant with other descriptions 
(“persuasive,” “creative,” etc.). However, if 
the employee were rated on the eight items 
identified as elements of job success, further 
ratings of his dependability, likableness, etc., 
would not contribute to а judgment of over- 
all success on the job. 

The results provide som 
on the criterion problem in one occupational 
setting. The complexity of the “success” 
criterion, and its identified dimensions, were 
forcefully illustrated. Since employee selec- 
tion and recruitment and student guidance 
programs all require the ability to forecast 
“success,” it is essential that further efforts 
be made to define this concept more explicitly 
in а variety of occupational settings. 
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EFFECTS OF APTITUDE-SCORE ADJUSTMENTS BY 
AGE CURVES ON PREDICTION OF JOB 
PERFORMANCE 


ROBERT C. DROEGE 


United States Employment Service, Washington, D. €. 


а TA was conducted by the United States Employment Service to deter- 
Eyes e пары validity of unadjusted and age-adjusted GATB aptitude scores 
studies. icting occupational success. 11 longitudinal occupational validation 
os € conducted on samples varying in size from 56 to 124 cases, were 
арб for the analysis. For each sample the validities of unadjusted and 

adjusted aptitude scores for predicting occupational success were compared 


i "mn 
Ed" 9 GATB aptitude measures. Diíferences between validities tended to be 


he 
i ave А 
m continues age of the nation’s labor resolved. Ultimately, the basis for deciding 
tet of older to increase, and growing num- between unadjusted and age-adjusted aptitude 
‘ted Workers are being involuntarily scores lies in the relative validity of the two 
rediction of performance 


Delleg cr te Е А 
we to loon logically displaced and com- sets of scores in predi 
in fing for. other jobs late in their for appropriate occupational samples. 


b tnding Many of th h d help 
UP Suit ose who nee — má: ESIGN REQUIREMENTS 
the ble able new employment will not ExpERMENTAL D " Qu 

e relative validity of unad- 


to 
djusted aptitude scores Te- 


y Obtain ; 
ha ain jobs closely related to those А study of th 


ары 44@ Previ 

оо бе testi iously. To what extent сап  justed and age-a! 
jp tons ting help determine what other егин а longitudinal rather than a cross- 
Si and pe ese older persons can learn sectional design for the following reasons: | 
R ае Tn Ws Successfully? 1. Maintenance of ability once acquired is 
aq "ш ы the research on development not the same as acquisition of a new ability. 
le The typical situation in cross-sectional studies 
d workers have been 


Sam, Соц л. atteries f e 

ble, Seling h or personnel selection 
Ы АЗ i i i t the employe ү ; 

be the Unger А; са us Е i liue quired the basic skills 
; 9l Dlicabn; rs, a question à 

ws vet ег, Cability of these test batteries ў 

MaigltStion ре, i igati «anced workers аге 
ating t А full tion of 

pai th experienc 


th Оре, оп 2 

e pay hi require. бе 

ч Ча SUN Marsi of (a) | i erformance may по 

e, „опер: еп aptitudes and аве, (0) occupations, Ре age. However, ability to 
wg е Ne e iderably with 


job may change cons! 
r of 


tug? Аһ i 
N A £ p ri job performance ап 
918 і i ti- б <, "n 
а age, and learning ability may be а facto 


UNES Performan 

Joy ®sp ticle į ce, and age. ge, ane tance to the e mployer. 

e M ` in Concerned with research o 2*3 P ross-sectional studies it is often dif- 

М mane €trelationships of aptitudes, А it to obtain comparable measures of job 
- » and age. Specifically, the fcu е for individuals in the various age 


а Apt, 5 о 

ce Ut n Ha 

th "des i Validity of age adjustments . vor example, the older, more ex- 
Se Пе 4 27 Dredicti . intervals. : 

М mU ul Joh ap erienced workers may tend to occupy the 


t ; “Ве adi er 
i TOR Sjustments referred 00 s most favorab k positions 50 that their 


le wor d 
e compared directly to 


ле, the use, 

qui loe al аутара to develop age norms, performance cannot b І 

(y bini l age adjusted test score 15 the Phe performance of younger workers. Sim- 

ge Op Y of Broups, The question o the ану supervisory ratings may be biased in 
Cn ienced (and older) 


e 
f the more exper! 


а zi 
teg Be n Making such adjustments (0 
8 1 ms for j i g ao : 
or intelligence and ар vorkers 
old one which has not bee? NC 
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TABLE 1 


INFORMATION ON STUDIES INCLUDED IN THE ANALYSIS 


Occupation N Type of criterion 


Assembler, dry-cell and 
battery 
Automobile-body 
repairman, metal 
en 


ographer 88 | 118 

г operator 921.883 | 64 
ammunition 

ssembly II 73 

Mail sorter 80 


Maintenance man, 
building 

Mill inspector 

Psychiatric aid 

Hand sewer, shoes 

Tool-and-die maker 


86 | Instructor's ratings 
70 | Supervisor 


[; tings 
Supervisory ratings 


601.280 | 124 
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training success or early job success. 


PROCEDURE 


we 
The General Aptitude Test Battery (CATH) m 
used as the experimental test battery A a a 
search. The GATB consists of nine aptitu 
ured by 12 tests as follows: 


Aptitude Tests 


"n ac 
Three-Dimensional 5р 
Arithmetic Reason 
Vocabulary 


G—Intelligence 


| 
4. The criterion should be a measure 


3. As pointed out in a report on a cross- 
sectional study of age and job performance 
of Federal Mail Sorters (Walker, 1964): 


The composition of the youngest age group is not 
strictly comparable to that of Succeeding age groups. 
The youngest group includes the ambitious and the 
superior as well as the less ambitious and inept. 
Through the years, the characters of the age groups 
change as the substandard are discharged and some 
of the superior are Promoted. The oldest age groups 
of sorters, therefore, contain more of the accept- 
able workers with longer experience but fewer of 
the superior workers since these were selected for 


promotion or transfer to more attractive work [p. 
297]. 


This is the typical situation in cross-sectional 
studies, with little or no basis for an assump- 
tion of comparability of the younger and 
older groups. 

The ideal design for investigating the ap- 
plicability of adjustments in aptitude scores 
for age should have the following character- 
istics: 

1. The design should be longitudinal, that 
is, individuals in the sample should be tested 
with the aptitude tests before they are hired 
or selected for training, but test results should 
not be a factor in the selection, 

2. Only applicants without previous experi- 
ence or training in the occupation studied 
should be included in the sample. This is an 
important requirement because aptitude tests 


are designed for use in Predicting ability to 
acquire new skills. 


3. The sample should cover a wide age 
range to permit meaningful comparison of 
unadjusted and age-adjusted sets of scores. 


V—Verbal Aptitude Vocabulary " 
N—Numerical Aptitude Arithmetic Reas 
Computation — ый space 
S—Spatial Aptitude Three- Dime a е 
P—Form Perception Form Match 
Tool Marching |. 
à ari 
О—С1егїса1 Perception Name Compar! 
K—Motor Coordination Mark Making 
F—Finger Dexterity Assemble 
Disassemble 
M—Manual Dexterity Place 
Turn Я 
Ji 
ap 
k , GAT! w 
Studies on the relationship between. rige e 
tude scores and age for adults ( Хх 


Verbal Aptitude (V) decline with а ith p 
there is variation among the aptitudes studie pi? 
to age of onset of decline. In these relatio" 
curves were constructed showing the de ane 
between average scores on cach ари vili 
Over an age range from 17 to 72. ДОВ 
reasonably good age-curve data for im norm" pe 
made possible the development of ы 

the aptitudes. That is, obtained scot jtitu MA 
adjusted so that the average adjusted bai sinc? 
was the same throughout the age range- iU sl 


wi 
as i соге5 adj 
was a marked decline in obtained Wem ing ? 


viduals су 
rvice «ali 


" -test nU, 
e e 
has a continuing program of aptitud the ©, jf 


tion studies on specific occupations, m a 
GATB is used as the experimental te yeri se 
each study. Eleven of these studies БОЙУ Opi 
for analyses to determine relative val cores: К 
adjusted and age-adjusted aptitude in T^ ul 
information on these studies is Som ies 

The following characteristics of these 5 5 
be noted: 


itudes © 
bert, & Henkin, 1963) show that all aptit! d Pl 


on most of the aptitudes, the con 
ments were substantial for older y 
The United States Employment Se 


1. АП were conducted using a Joe 
that is, the individuals in the samy 
Prior to entry on the job or into the an 7 
but the aptitude Scores were not usc 

2. Six of the samples consisted 


o etel 
sons: five co” 
Workers in specific occupations; 
trainees for specific occupations. 


ADJUSTMENTS FOR AGE AND PREDICTION OF PERFORMANCE 
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TABLE 2 


Mew 
‘AN, STAND 
NDARD А " d 
А DEVIATION, RANGE, AND PRoDUCT-MOMENT CORRELATION WITH THE CRITERION (r) FOR YEARS 
OF AGE AND YEARS OF EDUCATION ў 


@ Years of age Years of education 
ccupation 
Aes M SD Range r M SD Range r 
Ашы, dry-cell 
К lomobile ро T and battery 29.0 9.1 | 18-51 93 9.6 19 6-14 40 
Clerk stenogra g ce Pairman, metal | 28.6 15 | 18-81 | —03 | 104 | 17 6-14 | —02 
Lap Yor ы 260 | 95 | 17-38 | —34**] 120 7 | 944 | —09 
Meee ammu SE 36.8 T1 | 23-54 44 | 107 2.5 1-16 10 
Wil song, Union assembly IT | 353 69 | 21-531 | —36**| 11.6 » | sn Lo 
Mj ance Bs А 33.1 94 3-53 16 127 1.7 9-16 M3 
Ps ресор 7 building 41.9 9.6 07 98 1.6 6-12 01 
шанс aid 20.2 8.6 2| —45 12.1 24 6-17 .25* 
Ta Sewer, g} 25.3 7.5 17-52 16 12.1 7 10-14 n 
Мапа аро 1085 Pe} asa |e} 4| 35] 49 E x 
ui 235 | 40 | 19-35 | —16 | 11 s |1016 | .18* 
* = | 
SP <, X aa 
ae i qd 
3, 
Code The last thr ч D C 
Ste leet the «ee digits of the DOT (3rd edition) scores and age for adults (Droege, Crambert, 
а Partmene Deity of the occupation (United & Henkin, 1963). For each aptitude, the age 
Descr 1965 ^ Labor, Bureau of Employment — group. with the highest average score was 
d A cu уези @ 
ne he iP the 11 poc: range of complexity іё  ijoniged. This average score Was then used 
of, Май е tria с те. the base point for making score adjust- 
itero Sorte, COnsisted of ratings for all except 28 te 2257: . -other аре Bi i 
Pooled Was al Sample for which a work-sample ments for individuals in other age groups. — 
of ty Гару ° tined, For some of the samples, in Table 3 show that there is 
Sam VO on F5 representi e р The data B d h 
Ай, г more eee the composite judgment variation among samples with regard to the 
ity dan” One 1 с18, Mere obtained. For other xtelit to which age adjustments affect means 
m, ton ndividual did the rating. Reli- ЄХ ae f aptitude scores. 
ah he criteria w. i d standard deviations of ap à 
ith le 5 eria were not available. and 5 aa е the aptitudes 
Wi OF the Shows а There is similar variation among " ca 
[м tang. Simples ata on age and education for for the separate samples. Notice that the ag 
Жад de ie that there is a relatively "ustments always result in decreases in 
Sq for Considers i cach sample. This was an adjustm ? 
tyes han i ion in the selection of the mean scores. on between the 
sig ast spe ent investigation. Two of the Table 4 shows the correlation be! Wo 
ч ал And the ot negative correlations be- criterion of performance on the job o : 
the co: Positive „гоп: and two ofen haye "ing and the unadjusted and age-adjuste 
terion, © Correlations between education гай ores. Many of the validity coeffi- 
aptitude Scores. -f i айсапі for both 
cients are statistically significan де Soes 
| h R А а age-adjusted aptitu e S . 
log Mean ESULTS unadjusted an ge бетепсе in validity 
unadi н .. able 5 shows i : 
(у Салт the djusted GATB aptitude score coefficients of the age-adjusted and unad 
at ditg d B ве p, дага deviation is 20 for "usted aptitude scores. Small differences are 
inp tates З Working-population sample M enificant in some instances because of the 
plas Ment oo of Labor, Burt high correlations between unadjusted and 
n Steg devin .ecurity, 1962). Means and age-adjusted scores, which have an important 
US tina of unadjusted and ase & P the significance level (Guilford, 
iN Man i n Scores for the 11 samples rn 
UN the de fro le 3. The age adjustments Table 6 shows the distribution of the 
ta Pur sta the age curves obtaine validity differences for all 9 aptitudes and 11 
оп; le sample in the study on аре The median difference is 00, 
E: 5. 


'P between GATB aptitude 
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TABLE 3 
MEANS AND STANDARD DEVIATIONS OF UNADJUSTED AND ADJUSTED GATB APTITUDE SCORES 


FOR THE 11 SAMPLES 


Aptitudes of the General Aptitude Test Battery 


Occupation 
G у N s Р Q K Е 
Assembler, dry-cell and battery 
M 902 | 903 | 907 | 944] 976] 975 | 964 | 1044 
925 | 942 | 923 | 995 | 1038 | 1015 | 99.8 | 1042 
5D 134 | 125 | 157 | 16.5 | 178| 157| 158 we 
132 | 131| 154 | 154 | 153| 148| 160 | 19. 
Automobile-body repairman, metal 
M 96.3 | 933 | 89.7 | 1102 | 969 | 957 | 887 | 1046 
975 | 969 | 012 | 1146 | 1024 | 988| 913 1068 
SD 15.3 | 15.0 | 150] 17.2] 159] 15.5 | 202 1 
2) 140) 149 | 171 | 161| 153| 207 | 19 
Clerk-stenographer 1 
M 97.4 | 97.0 | 100.4 | 98.4 | 103.8 | 105.6 | 112.2 | 100. 4 
98.9 | 101.6 | 101.7 | 101.6 | 107.9 | 108.5 | 114.7 | 1 fan 
SD 149 | 123 | 149] 179 | 200] 142| 164 rr 
154 | 124 | 149 | 181| 182| 136 | 158 | 19 
Conveyor operator 
M 921 | 872| 900) 974] gra | тал | 726| 9H 
942 | $92| 930 | 1059 | 907 | 81| 790 ro 
SD 157 | 119 | 169 | 181] 166| 14.2] 175 Y 
163 | 122 | 16.8 | 176 | 15.5 | 142| 169| 19 
Laborer, ammunition assembly IT 4 
M 93.1 | 923 | 898 | 984] 908] 85.7 | 898 p 
95.1 | 946 | 91.9 | 105.8 | 10.3 | 917| 953 | 4 s 
SD 15.5 | 16.5 | 188] 170] 164] 165 | 198 p 
: 157 | 166 | 198 | 163 | 157| 158 | 193 | 1 
Mail sorter 
M 972 | 100.1 | 98.8 | отд | 1022 | 1059 | 107.0 A 
К 98.9 | 102.0 | 100.6 | 990 | 1117 | 1113 | 1117 |1 173 
D аг 15.1 | 157 | 174 | 166 | 149 by 184 
14 9 4 »^ E к 
Maintenance man, building "Á - "8 — -— 7 4 
M 88.8 | 91.2 | 854 | 91.6] 821| 88.7 | 849 D 
919 | 93.1| 88.2 | 1021| og6 | 98.3} 940 E 
SD 153 | 145 | 170| 162] 179 | 128 | 218 197 
e 157 | 144) 173| 164 | 180| 135| 210 ` 
Mill inspector 6 
M 103.5 | 923 | 101.7 | 109.0 | 968 | 852 | 832 we 
» 105.1 | 95.9 | 103.1 | 1141 | 1032 | 885 | 864 19.9 
200 | 169 | 186 | 191] 155 | 144 82 184 
— 19.8 | 165 | 186} 182| 140| 141| 17. М 
M 106.0 | 104.9 | 102.0 | 108.5 | 111.5 | 106.5 | 108.2 rot 
Bi 107.1 | 109.3 | 103.0 | 111.6 | 115.1 | 1088 | 109.9 | 1 20.1 
134 | 135 | 129 | 162] 165 | 125] 145 196 
Hand sewer, shoes o 155 - end E = on 5 
90.1 | 867 | 864 | 1000 | 94.7] 93.1 | 95.4 Er 
= 922 | 895 | $5.3 | 105.5 | 1030 | 98.5 | 1003 25.1 
163 | 159 | 188 | 190 | 187 | 135 | 18.6 23.9 
| 164 | 161| 191| 194 | 193| 142| 198 
Tool-and-die maker 5 
M 111.7 | 988 1078 | 1185 | 111.7 | 96.5 | 102.5 1030 
112.6 | 103.6 | 108.6 | 1205 | 1136 | 97.8 | 1033 |! 020 
SD 148 | 137] 147 | 163 | 153] 156 | 166 es 
150 | 139| 149) 164] 153 | 157 | 167 | 1% 


Note.—Ms and SDs of adjusted GATB aptitude scores are in italics, 
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TABLE 6 


DISTRIBUTION OF DIFFERENCES IN VALIDITY 
COEFFICIENTS OF AGE-ADJUSTED AND 
UNADJUSTED APTITUDE Scores 


— a 


Differences in validity 
(unadjusted — adjusted) 


Frequency 

Interval Midpoint 

108 to 10 | 09 5 

0510 07 06 8 

210. 94 D3 19 
—011о M 90 3» 
— 92 to — Өз -M n 

-twt — 87 — 06 5 

Discussion 


The results indicate that, in some instances, 
aptitude scores adjusted for age have valid- 
ities that are significantly different from 
validities of unadjusted scores. The sign and 
direction of the difference are dependent on 
the occupation, the age range represented in 
the sample, and the particular aptitude. These 
factors are discussed below: 

1. With reference to the 
cluded in this investigation, age adjustments 
in the aptitude Scores resulted in substantially 
higher validity for only one occupation (Con- 
veyor Operator), but such adjustments re- 
sulted in substantially lower validities for 
two occupations (Clerk-Stenographer and 
Laborer, Amunition Assembly II). For the 
remaining eight Occupations the differences 
between age-adjusted and unadjusted score 
validities were quite small. 


Occupations in- 


2. An important consideration іп the 
selection of the particular 11 samples for 
this investigation was the age range rep- 


resented in the sample. An attempt was made 
to include samples with high variability in 
years of age so that differences in unadjusted 
and age-adjusted sets of scores would be 
maximized, Obviously, in Studies based on 
samples which do not have a wide age range, 
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unadjusted and age-adjusted scores are 10! 
so likely to occur. P. 
3. The aptitudes for which smallest P 
ences in validity of unadjusted and ni 
justed scores were Intelligence, Verbal iis 
tude, and Numerical Aptitude. ote b 
aptitudes validity appears to be ша 
affected when aptitude scores are а J A 
for age. The primary reason for this PP i 
to be the fact that these three — E 
show little or no decline with age, W 
the other aptitudes all show — 1: 
decline in average score with age а 
age of onset of decline. ней" 
The present investigation was M d 
comparisons of validity кшш scott 
adjusted and age-adjusted aptitu * focus 
The USES plans an additional ШУ ed ap 
on the individuals who fail establis apati B 
tude cutting scores for specific m p 
When unadjusted scores are used vast 
the same cutting scores when age one {0 
Scores are used. Analyses will be " iit 
determine whether these workers be ji 
from a fail to a pass category are п 
successful or unsuccessful workers. 


К i 
substantial differences between validities 
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In a vigi 
Pall nie task which simulated 
о report the occurrence of 2 


was conti 
n ilo Н 
ы шы modulated in amplitude by а 
-min sessions Ss reported signals only 
in 2 further 


identificati 
a (Sure procedure); 
Jike sound (Unsure procedure). 


both “weak” 

th “weak” and “strong” signals was 
o higher with the 
e in decision criterion rather than in dis 


ы о rate was als 

Chin: that this reflected a chang 

anise pee efficiency. Within-session 

tention о signal strength or reportin| 

this En that decision processes play 
kind of task. 


3 recent y 

fa Own pom considerable interest has 
Pulse ays of the theory 
961) to cur (Swets, Tanner, & 
Че орегано havior in tasks which 
ively rare r to keep watch for weak 
Atgets, in oe such as radar and 
м ёкогу | ү setting (Broad- 
d. ty Mackworth 963; Jerison & Pickett, 
“cision OMSiders q & Taylor, 1963). This 
TOCess ed id as essentially 2 
© crite based on a statistical cri- 
likes i may be altered by 3 
“set p including the operator 
АЛ at, when ‘or example, Evans (1965) 
Set instructed to adopt à risky 
› „ы (Ss) made earlier 
h ed uL false reports, than 
Qi, he ч opt a cautious reporting 

е ans g 
| “iain Ж A a video display W25 
А luce degree e inbound radar tracks. 
Ret gd by оң temporal uncertainty was 
Scans the range at which the 
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in nct was presented on а 
UL kn presence of an examiner 
Was owledge of results. The 
also concerned with the 
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sonar target detection, 12 Ss were re- 
00 msec pulses in a 900 cps tone, which 


low-bandwidth noise source. 
when quite certain of their 
3 sessions they reported any 
5 substantially Yücher percentaze ot 
etected with the Unsure procedure. 


Unsure procedure, but analysis 


decrement was slight, and unrelated 
_ The results support the con- 
Je in determining performance at 


effect of reporting set on target detection, b 
here performance was observed in аут pu 
ituation, that is, in a prolonged 
h no knowledge of results, and 
were monitored auditorily, кани 
video display, in order to simulate 
tions where this mode of 


vigilance S 
session. wit 
the signals 
than on à 
certain sonar opera 
presentation is employed. 


METHOD 


F {pparatus 


The sonar target 
ment was an elec 
signal-to-noise атр! 
Tt generated a continuous 
amplitude modulated by à 
cycles-per-second) random noise source. The target 
*sienals" consisted of pulses produced by removing 
the noise modulation and simultaneously raising the 
litude for approximately 200 milliseconds. 
e amplitudes, the values of which re- 
z ratios of 9.7 10.8, 11.8, and 12.6 
being taken as the root 


simulator used in this experi- 
tronic device with a variable 
litude (S/N) ratio capability. 
900-cycle-per-second tone, 
low bandwidth (0-10 


im. Responses made 
had occurred were 


d in fr 5 
onds after а S! 
orts. 


t detection 0 


d Procedure 
sted men of the Roval Navy, 
of monitoring. Each 5 
g, following which he 


Subjects an 


The Ss wer 


unfamiliar wi 
iven severa 


e 12 enli: 
th this form 
] hours trainin! 
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performed the task for 8 sessions, each of 45 minutes' 
duration, at the rate of 2 sessions per day. Sessions 
2, 3, 4, and б, 7, 8 were regular "test" sessions; 
Sessions 1 and 5 were "instructional" sessions during 
which S was taught to adopt one of the following 
procedures for reporting signals: 

“Sure” procedure: S was required to report a 
signal only when he was quite certain that he had 
indentified a sound as such. 

“Unsure” procedure: S was required to report any 
sound which he considered might be a signal. 

Six Ss were taught the Sure procedure on Session 1 
and the Unsure procedure on Session 5; the other 
6 Ss were taught in the reverse order. In each of 
the sessions 36 signals were presented. Intersignal 
intervals were randomly determined within the con- 
straint that 3 signals of each strength occurred in 
each successive 15-minute period of the session. The 
order in which the different signal strengths were 
represented was randomized within each period 


RESULTS 


The proportion of signals detected with the 
Unsure procedure was substantially greater 
than the proportion detected with the Sure 
procedure at each of the four signal strengths. 
Analysis of variance of the overall detection 
scores showed that the main effects of pro- 
cedure and of signal strength were both 
statistically significant, F (1/10) = 30.5, p 
<.001; and F (3/66)=74.1, p< 001, 
respectively. However, there was no signifi- 
cant degree of interaction between these ef- 
fects. The relation between detection score 
and signal strength was apparently linear 
with both procedures (Figure 1). No signifi- 
cant effect of practice was observed, but the 


во 


70 UNSURE 
PROCEDURE 


60 


50 


40. 
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PROCEDURE 
30 


PERCENT SIGNALS DETECTED 


95 100 105 ПО Is 120 125 130 
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Fic. 1. Percentage of signals detected at four levels of 
signal strength, with two reporting procedures. 
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TABLE 1 


OVERALL PERFORMANCE SCORES WITH SURE 
AND Unsure Procep 


— = = - ———— 
Performance measure Unsure 
RN penc I—-——— 
Percentage of signals detected | 37.6 | a 
Median no. false reports 16.0 m 
Median d’ 2.2 56 
Median 8 20.0 90 
ix 5 


overall mean detection score for the $ re 
who performed first with the Sure procedi 
was significantly lower than the score for ire 
six Ss who performed first with the baer, 
procedure, F (1/10) = 6.6, р < .05. This M 
have been caused by a “carry-over” п 
the first procedure experienced upon perfor 
ance with the second, that is, to 4 pan 

failure of the second instructional sess!" the 
overcome the pattern of behavior set Y her 
first. However, all 12 Ss returned а dur 
detection score with the Unsure proce of 
than with the Sure procedure, regardle™ 
the order in which they were tested. 

The median false report rate with pe 
sure procedure was 3.5 times as d 0! 
rate with the Sure procedure (Table и the 
the 12 Ss, 11 made more false reports a pr^ 
former condition: the difference betwee! 01. 
cedures was statistically significant test): 
Wilcoxon matched-pairs signed-ranks p ri 

The substantial increase in defen, abl? 
with the Unsure procedure cannot ren the 
be accounted for on the supposition fected 2 
accompanying rise in false reports Ге, Eve 
higher incidence of random “guessing і 
with the relatively high response pon of ^ 
by this procedure the chance probab! А sí p 
report being made within 3 seconds 0 ited d 
was only 0.04 (this figure was сотр! s 
the assumption that no more than one whit 
could be made in any 3-second perio® 
was empirically correct). ; yum е 

Given the assumption of a max!" can ^ 
sponse rate of one per 3 seconds, № ; fal 
shown that the probability of makra e m 
report was 0.007 with the Sure ргосес giff? 


Un 


e ie 
0.029 with the Unsure procedure. к alte y 
ence of only 0.022 resulting from t M 


è E aret, 
tion in procedure should be want ШУ 
the much greater change in the pro? 


"s 


Sonar TARGET DETECTION 


РЕвскут, TABLE 2 

NTAGE OF Sic 

тойы ы DETECTED IN SUCCESSIVE 
d ERIODS OF THE TEsT SESSIONS. 


Report; 
tin, Ы. "ithin-sessi i 
оок) 15 | К Within-session period 
3 gth ae чк 
Au - First. Second Third 
1 (weak) 
2 
| 3 
Я | 3 (strong) 
Unsure i 
weak 
Я сак) 
3 
_ 4 (strong) 
tect Sa cum: == 
оп 
0245 ^A (Table 1); | - 
We hich is over here the difference was 
à 
m ereas this dis 10 times as large. 
relation between detections 


the , ^ S6 re $ 
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Ro obe a rr tion fur fü latier based 
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DOE eden ise nier 
ased on report is considered as 
al., 1961) a statistical criterion 
this ee of the results 
aed ae Ё (ignoring signal 
With bail a decision. interval 
didec procedures 7) showed 
an ecision criterion) was sig- 
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nge in reporting procedure. 
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0 ates i Я " 
: e ie in successive 15-minute 
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NS 
Mep, TSt, t 
Spa Pra any marked within-session 
ed, and, second, that the 
i e 
" ре values of the statistics 
бырт» of the theory of signa 
that the assumed decision-interval 
qi, its M. Y sli estimates of changes 10 these 
"еа Ssess e Ehtly affected by considerable 
"е nt, even to the extent of а 30- 
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extent of such decrement was related ei 
to the reporting procedure or to th о 
strength (theorie: "igi E Signal 
g s of vigilance that att 
to account for decrement as an i s 
> increase in 
sensory threshold during the test i 
would predict greater decrement at кч 
values of the latter). These detection Minn 
are given in Table 2, from which the "rii 
ing conclusions may be drawn: first той 
decrement did occur during test mica, bot 
its extent was relatively small; second, i» 
decrement did not appear to be affected by 
the change in reporting procedure; and third, 
it was not related in any systematic way t j 
the signal strength. da 
Pooled within-session performance changes 
are shown in Table 3. The greatest decrement 
in detection score occurred between the first 
and second test periods; the false report rate 
also declined during this time. Both changes 
in score were statistically significant (р < 
01, Wilcoxon tests). Whereas d' was virtually 
identical in the two periods, £ rose consider- 
ably; however, the increase in 8 just failed to 
reach statistical significance at the 596 level 


of confidence (Wilcoxon test). 


DISCUSSION 
at a substantial increase in 
igilance tasks such as sonar 
target detection can be achieved by encourag- 
ing Ss to report signals even when they are 

ir identification. The re- 


uncertain as to thei 
sults obtained show that the improvement in 
and 


performance applies equally to weak 
strong signals. Analysis in terms of the theory 
of signal detectability indicates that the rise 
in false report rate that follows the adoption 
of a “risky” reporting procedure does not 


It appears th 
detection rate in v: 


TABLE 3 
с̧еѕ510Ҹ TRENDS IN VARIOUS PERFORMANCE 
gs, POOLED OVER ALL SESSIONS 
SIGNAL STRENGTHS 


WITHIN- 


MEASURES, 
AND 


Performance measure г 
a а | 
First | Second | Third 


$41 | 454 | 49.7 


centage of signals detected | 
285 | 200 | 230 


Per 


Median no. false reports 
Median d' 23 | 24 22 
Median 8 1.6 | 110 | 10.0 
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represent a change in the actual efficiency 
with which signals are discriminated, but, 
rather, a shift in the criterion used to make 
decisions about responding. This demonstra- 
tion that performance can readily be manipu- 
lated by variation in instructions emphasizes 
the importance of careful control over the 
training given to Ss in experiments on vigil- 
ance, and supports previous work in showing 
that attempts to construct theories of be- 
havior in these tasks must take into account 
the decision processes involved. In practical 
situations, the question of whether an in- 
creased rate of detection of real targets is 
acceptable when accompanied by a higher 
probability of an incorrect identification is 
one that must be determined on the basis of 
the relative values and costs involved. 

The fact that there was a positive rela- 
tionship between signal strength and prob- 
ability of detection is perhaps not surprising, 
in view of the similar findings of earlier stud- 
ies on this point (reviewed by Jerison & 
Pickett, 1963); however, it is worthy of note 
that in these studies the effect of signal 
strength was typically investigated by chang- 
ing its value in separate trials, rather than, as 
here, by comparing detection rates for differ- 
ent levels in the same session. Also of interest 
in the present result is the apparently close 
approximation of the relationship to a simple 
linear function over the range of signal 
strengths covered. 

The finding that within-session decrement 
was relatively slight is consistent with the 
hypothesis advanced elsewhere (Colquhoun & 
Baddeley, 1964) that much of the decrement 
usually shown in vigilance tasks of this kind 
is due to the practice of testing Ss once only, 
without providing adequate prior experience 
of the average probability of signal occur- 
rence. When, as in the present case, Ss are 
tested repeatedly, with an invariant signal 
probability, this major cause of decrement is 
obviated. However, a certain “residual” de- 
crement may, as here, still occur. 

The true cause of this residual decrement 
remains to be identified. The fact that in 
this experiment its magnitude was unrelated 
to signal strength would seem to disprove, at 
least, the argument that it reflects a пзе in 
sensory threshold due to some sort of “fa- 
tigue." The indications in the present re- 


sults were that the decrement is produced by 
а shift in decision criterion rather than by à 
change in signal detectability. Whereas such 
a conclusion would be in line with the results 
of Broadbent and Gregory (1963), Loeb and 
Binford (1964), and Wiener, Poock, an 

Steele (1964, as reanalyzed by Taylor, 1965), 
it would conflict with those of Mackworth 
and Taylor (1963) and Mackworth (1965): 
where a decline in d' with time on task Wa 
consistently found. Although the experiments 
in which no change in signal detectability 
has been observed varied both in the sensory 
mode employed (visual or auditory) and n 
the nature of the task itself (discrimination 
between "signal" and “nonsignal” events, 0 
detection of a change in a continuous input): 
the Mackworth studies are the only ones ™ 
which the particular combination of уйш 
mode and continuous input has been Е 
vestigated; this fact may be of significan 
for future research in this area. 
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The salient reasons for current job satisfaction were compared for high- and 
chnicians) in the framework of Herzberg’s 


low-sati : 
Ow-satisfaction respondents (613 te 


stated that “motivators” are the 


5. В 
2-factor hypothesis. An alternate notion "s 
“hygiene” factors act to limit complete 


ri i Р a iih: Я 
Prime influencers of satisfaction while 


Satisfacti 2 : 
eg ron for highs and complete dissa 
y supporting neither formulation, we 


th Һ 
е alternate conception. The mounting r 
to handle devian 


the i Eos 

ye Baby of the 2-factor theory 

of R at the satisfiers/dissatishers concept. 
Otter's Social Learning Theory. 


ent of The Motivation to 
реа? а flurry 5, Mausner, & Snyderman, 
int, Cd Which of articles and reviews have 
in (те ation Purport to throw light on the 


tisfaction for lows. The data, while 
re more adequately coordinated with 
body of contradictory results and 
t cases calls for a fresh 


A new construct is offered in terms 


erate on the negative side (Herz- 
berg et al., 1959, pp. 111-112). 

Despite several studies specifically de- 
signed to test the concept, not to mention 
numerous studies of general job attitudes 


variables op! 


in 
tha, of job sati ы ed 
jd notio EF Ldi poi which have been interpreted within the frame- 
Ms s eg Poses that two distinct sets of work of the Herzberg formulation, at the 
Sati fir x ior overall job satisfaction. present time it is not at all clear the extent 
Ча 8, a *t called motivator factors OF to which the ocean po of job 
М моц. des variables which are gen- satisfaction can OT shoul | be perm. 
Ment and Telated, for example, work in- beyond the specific рор ulation AH еши 
vt й reco challenge, aenn advance- ology employed in the initial Eo б 
LM teme ction, and so forth The second Several studies have essentia) y ralis 
Oy te to ^ hygiene factors : dissatisfiers the Herzberg design and have yielded com- 
or dissatisit' parable results. Myers (1964) reported data 
p vg with 282 employees at Texas 


, Con, Atia] к Е 
his texty bles which are work supporting 


from interview i А 
esenting а range of job 


In 
. Bs al t 1 
NS n techni E — including Swe Instruments, Inc., repr 
weg, Sag dns corporate categories from scientists to female assem- 
h there were some significant 


Оц. “Er B 
Cepe "din Persona] relationships, physical 


blers. Althoug s, the overall 


n job categorie 


fy Ina; 5, etc 
у ins th The core of Herzberg’s COP" — qitferences betwee iom 
h eut € in at motivator factors account trends were interpreted as supporting | 
NUN tal heg, Overall job satisfaction above — yfotivation 0 Work explanation. € 
NNI Onic level with little or nO Jenusaitis, an Stark (1963) also rep ^ 
чле Satisfacti él Я dings from their questionnaire 
a. Уау, 180, ‘action below that level- supportive findings 1 nel, dn. the 
NUN lang ih On the other hand, account study among supervisory pigs) dents 
te oy! П overall job satisfaction below utility industry. ен С t Шрдей 
М Shop, Vera re level with little or no bear comparable findings vm Ж 

а Satisfacti that point. among supervisors ™ , ; 
Wo, tte me claim is th on above " nies However, as outlined by Ewen (1964) as 

Al "mag жей ог E sll as by Vroom (1964), there are some 

of te m surrounding the research 


ar 
job. Ally on the positive side 


ане d { 
isfaction scale while hygiene 
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strategy and methodology utilized m these 
studies which should caution against too- 
quick acceptance of the interpretation "n 
for the findings and their extension to the 
world of work in general. These cautions арг 
been reinforced by data from a number о 
studies explicitly discussed within the HUNG 
work of the Herzberg explanation which at 
least partially, if not totally, fail to support 
the predictions which one would make based 
upon the basic two-component hypothesis of 
job satisfaction (Ewen, 1964; Friedlander, 
1963, 1964; Gordon, 1965; Halpern, 1965; 
Malinovsky & Barry, 1965; Wernimont, 
1966). : . 

Furthermore, in addition to the growing 
number of studies which raise important 
questions about the concept, it is believed 
that Herzberg's data do not adequately test 
his own notion because the research was not 
based solely on current Satisfaction with a 
presently existing job situation. Herzberg (as 
did the other supportive studies cited above) 
asked his subjects (Ss) to think of a time 
when they were particularly happy or un- 
happy with their job, whether it be their 
present job or any other job they may have 
had. As a result, there is no control over the 

sampling frame for the data and no clear-cut 

basis for drawing inferences about the rela- 
tive contribution of various job factors to 
overall job satisfaction. 
A theory is only as powerful as its ability 
accommodate deviant Cases, and there is 
nothing in the Herzberg notion which pro- 
vides a basis for explaining cases which do 
not conform to the simple two-factor dichot- 
omy. The concept of expectancy is one com- 
ponent which is clearly missing from the 
formulation and Which, as Vroom (1964, 
рр. 17-18) points out, must be included as 
an integral part of any scheme for predicting 
levels of motivation or of job satisfaction, 

A recent study by Turner and Lawrence 
(1965), while not interpreted within the 
Motivation to Work framework, presents 
compelling data showing the importance of 
moderating variables of work-group culture 
in the dynamics of job satisfaction—for 
workers of one cultural background, jobs 
characterized as varied, complex, and de- 
manding were associated with high job satis- 


to 
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faction; for workers of a different еШ 
background, such jobs tended to be wem 
with low job satisfaction in direct con k 
with what one would expect from the simp 

motivator/hygiene concept. -— 

It is contended, moreover, that still “nich 
factors must be included in any theory ч p: 
hopes to explain the basic dynamics bi i 
satisfaction. Certainly experience or exp "m. 
to various job attributes is one. The dit 
portance which an individual ascribes ci ail 
ferent job attributes is another ШО aa 
importance variable can reflect other а E 
factors such as personality чаги. are 
cultural or social system variables yn inf 
certainly to be accounted for in any prec 
theoretical statement. 

Most of these considerations ar JA 
only tangentially, if at all, in the pr it 
analysis; at the end of this paper p^ an pe 
hypothesis of job satisfaction Tearns 
developed based upon the Social F to 
Theory (Rotter, 1954) which ане put 
incorporate these missing componen rovide 
first, the study reported below may em of 
additional insights toward the develo tis 
a more comprehensive theory of JO 
faction. 


The Present Study sti 
The study reported in this раре ite ale 
gated the tenability of the Herzber fet! 
(1959) hypothesis concerning the p on 
dissatisfier or motivator/hygiene E y ax 
overall job satisfaction using data ae „enl 
sessing present satisfaction with 4 a at 
job situation. In addition, the study lo pic” 
respondent's perceptions of factors 
tended to influence their current eit 
satisfaction positively, as well as the que 
ceptions of factors which tended to ЇЇ 
satisfaction negatively. direct 
The hypotheses for this study peur ro™ 
at variance with what one would prec rement 
the Herzberg et al. theoretical pa it wa 
Rather than operating unidirectionally conte, 
hypothesized that the types of a $ 
factors which Herzberg labeled ШЕШ pot 
would operate bidirectionally by but ү 
the primary cause of positive satisfac g 
high-satisfaction respondents, as well ? 


г inve 


Two-F 4 
wo-Factor HYPOTHESIS oF JOB SATISFACTION 


primar: 5 
* lov-satisfactior S negative satisfaction for 
“hygiene” sadi It was hypothesized that 
vould thus — on the other hand, 
total satisfa e responsible for the lack of 
br the lac weg for high-satisfaction Ss and 
отаев Se. dissatisfaction for the 
ot " 2 
o wd voras motivators were predicted 
е high de novers of satisfaction. Because of 
With such gree of ego involvement associated 
achieveme job attributes as work challenge, 
the other ye recognition, advancement, and 
\ Should P eni. it was felt that these 
Variables y represent the most powerful 
2 nig ie ОО eet in contributing to 
ould be c and conversely their absence 
ost potent in contributing to job 


Issa tisf. 

acti 

wears Жош On the other hand, hygiene 
сак in logically operate as relatively 


flu . 
ү "or that is, the reasons satisfied 
dis nS dissati apiy satisfied and the 
Satis woe people are not completely 
Sa ble | sy nit picks," if you wish. 
i b pre the prediction which 
a Doth able 2 kiah the Herzberg hypothesis, 
for 8164 for etus the relationships hy- 
Satis ividuals es study. Each table shows, 
and es ho report they are currently 
ed, the hose who report they are 
ing, Would Lese most-salient factors 
А * in тайы cited as having the most 
Mog hich Á— current satisfaction and 
йеп, vould be cited as having the 
* in depressing satisfaction. 


Reg 
Pendent METHOD 
Wale g, 
tiap, Ss 
ns SS for 
i а 
Wolvec s present study Were 613 tech- 
n service work all of whom were 
Pra 
bic. " 
ons TABLE 1 
Mo... TRO 
d яке Herzpere’s FoRMULATION OF THE 
тур Ons Factors OPERATING AS 
ON бук AS NEGATIVE INFLUENCES 
AS A n n Jon SATISFACTION 
=з Le UNCTION OF PRESENT 
у 
Ire, кы _ = m 
ingt _——====== 
їп 5 iow EE 
псе averat present job satisfaction 


| High 


‹ 
— | E 
Hy motivators 
^ri 3 ne | Primarily motiva 
fur i йу motivators 
marily hygiene | Primarily mot" ators 
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TABLE 2 


PREDICTION FOR PRESENT STUDY 
F ACTORS OPERATING AS poem pens meet 
INFLUENCES ON OVERALL JOB нетов. и 
AS A FUNCTION OF PRESENT LEVEL i 
OF SATISFACTION ï 


" Level of present job sati 
Direction of present job satisfaction 
influence 


Low High 


rimarily hygie: imari 
Primarily hygiene Primarily motivators 


Positive factors 
Primarily motivators | Prim hygiene 


Negative factors 


fep жели 


presently employed by the same large national 
company. In the spring of 1965 a general attitude 
survey of the entire population of technicians was 
carried out. The survey resulted in a 75% response 
rate for a total of 10,000 completed questionnaires 
The average age oi the participating respondents 
was 32.7, with 92% of the sample under 45 Senis 
oí age. There Were 84% who had some education 
beyond а high school diploma. Nonmanagerial posi- 
tions were held by 93%, and 85% had been with 
the company 3 years or more. All of the respondents 
were males. From the returned questionnaires, 1 out 
of every 16 were systematically selected to form 
the sample for the present study. The characteristics 
of the selected sample closely mirrored those of the 
population from which it was drawn. 


Overall Job Satisfaction 


At the beginning of the attitude-survey question- 
naire an overall-job-satisfaction question was asked, 
utilizing an 11-point response scale: 


Measuring 


how would you 
as an [XYZ Com- 


e? (Circle one number on the scale 
how you feel.) 


Now, considering everything, 
rate your present satisfaction 
pany] employe! 


below which best expresses 


01253 48367 8 9 10 
Completely Completely 
Dissatisfied Satisfied 


n in the question- 


as the first questio: 
ctured assessment 


Since this W: 
entially an unstru 


naire it was essi 
of the respondents overall level of current. satisfac- 
tion. 
Measuring Job Factors Responsible for Over- 
all Satisfaction 
Immediately following the overall-satisfaction 
ended items: 


question were the following open- 
A. List one or two specific things that most 


influence your feelings in à positive way about 


your employment with [XYZ Company 1. 


ne 


—À 
— MÀ 
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B. Now, list one or two specific things that most 
influence your feelings in a negative way about 
your employment with [XYZ Company]. 


1. 
2 


High-Low Overall Job Satisjaction 


Responses for the 613 men in the sample had a 
mean of 7.04 on the overall-job-satisfaction question 
and a standard deviation of 1.82. Respondents 
Scoring 6 and below on the scale (N = 158) were 
classified as forming a "low Present satisfaction” 
group, and those scoring 7 or above (N —455) a 
"high satisfaction" group. The Selection of the 
cutting point was dictated in 


а positive to a negative tone. The authors were 
also Constrained, however, to keep the cutting point 


across the full range the satisfaction scale, be- 


coming more Pronounced the lower the cutting 
point.) 


Classification о Í Satisfiers and Dissatisfiers 


tion to Work (рр. 44-49) was followed. 


(c) Growth of Skills and Abilities 
(d) Advancement 

(e) Work Itself 

(f) Autonomy 


Dissatisfiers: 


(a) Interpersonal Relationships with Peers and/or 
Subordinates—While 7% of this sample were mana. 
gers, they were not identified as Such when coding 
the open-ended questions. It was therefore difficult 
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to tell whether the interpersonal relationship referred 
to a peer or to a subordinate. Therefore, thes 
categories have been combined. | 

(b) Interpersonal Relationship—Supervisor 

(c) Supervision— Technical 

(d) Company Policy and Administration 

(e) Working Conditions 

(f) Job Security aid 

(g) Benefits—This is not a Herzberg category су. 
would ordinarily be classified with Corporate Pon 
In this analysis, possibly because of the culture ^ 
the specific company investigated, it loomed 25 
highly distinct response. not 

(k) Status—Status responses per se were с 
obtained. Herzberg's scheme calls for sepone си 
ferring to physical signs of status; status resp fe 
registered in this study dealt with the status der 
from belonging to an organization like “the into 
Company.” These were eventually collapsed 
Corporate Policy, 

(i) Personal Life 


Others: 


& ers 
(а) Wages—Since wages may be either ss 
or dissatisfiers depending upon their os jon 
they were classified separately where the imp 
Was not explicit, tive feel 
(b) No Response—No negative or зу” do 
ings were coded. If a respondent said, “1 dae E. 
not have any negative (positive) feelings put 
it was coded as “по negative (positive) both the 
Tf a questionnaire had no responses in ned i” 
Positive and negative categories it was decider’ 
valid. (1.9% of the questionnaires were СО onaents 
invalid, reducing the final N to 613 resp 
from an initial sample of 625.) 


Reliability of the Coding 


te 

Considering all 16 coding categories, sone was 
agreement between the two independent T reemer 
80.7%, and т, the index of intercoder ane the 
was 78.7 (Robinson, 1957). The index re Валс. 
extent to which coding reliability exceeds E "ub. 

Considering only the three categorics rate ° 
satisfiers,” “satisfiers,” and “wages,” the Е 
agreement was 91.6% with т = 843. animo" 

For each and every disagreement, UP he wa 
agreement was eventualiy reached between yas use 
coders, and the finally agreed upon code Y 
in Subsequent data analyses. 


Weighting of Open-Ended Responses яе 0 
“ 

Each respondent was instructed to list р stt 
two specific things" as negative and as to ШО 
reasons for job satisfaction. This was done i were 
more than one job factor to emerge if isting: 
sufficiently important. In some cases, (0 ес D 
factors were mentioned; in others, two 25P^ com! 


" tive . ел 
job factor. In coding responses, each ров ve 
each negative set of responses for each 5 


| 


х TABLE 3 
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TABLE 4 
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Source d æ 


Level of Job Satisfaction X Positive 1 | сж 
and Negative Reasons is 
Level of Job Satisfaction is 
uium Factor siad d ear 
Type of Motivation Factor X Positive | 2 
and Negative Reasons 
Type of Motivation Factor X Positive | 2 
and Negative Reasons X Level of 
Job Satisfaction 
Total 


жр 2.10. 
»* p <.01. 
жар < .005. 


115,9*** 


56.7*** 


7 | 182.5*** 


a weight of 2. Thus, for example, if two job factors 
were mentioned as positive reasons each received a 
weight of 1; if the same job factor was mentioned 
twice as à positive reason, it received a weight of 2; 
and if only one aspect of one job factor was iens 
tioned it too received a weight of 2. This procedure 
in effect weighted responses for saliency and equalized 

ts with differing levels 


the weight given to responden 
ization. It also allowed for the inclusion 


tioned. On the average, each S men- 
-half separate responses ; 59% 
de two distinct responses in the positive 
the negative categories. In those cases 
than two responses were given, only 


ere coded. 


tioned three and one 


where more 
the first two W 


RESULTS 


data are presented in Table 3 
umber of weighted mentions of 
d the proportions 
mentioned as positive 
or as nega for the present level of 
overall sa the high- and low- 
satisfaction groups. A three-way analysis of 
chi-square was performed (Winer, 1962), and 

in Table 4. 


the results are presented in' 7 
1, Level of Job Satisfaction X Positive and 


Negative Reasons. This result indicates that 
the proportion ositive versus negative 
reasons is not significantly related to level of 
job satisfaction. This is to be expected since 
the instructions and the weighting scheme 

ch as positive and 


forced two responses ea! 
negative reasons for each respondent. It is 


true, however, that а “по mention" was con- 
sidered а valid response. 
] of Job Satisfaction X Type of 


2. Leve à ion 
Motivation Factor. This statistically signif- 


The primary 


and show then 


the motivation factors ап 


with which each wer 
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cant chi-square is accounted for by slight dif- 
ferences between the two groups in the fre- 
quency with which money and hygiene 
variables are mentioned. 7 

3. Type of Motivation Factor x Positive 
and Negative Reasons. This significant result 
accounts for the greatest proportion of the 
total chi-square. It indicates that: 


(a) A greater proportion of hygiene fac- 
tors are mentioned as negative as opposed to 
positive reasons (p < 0001). 

(b) A greater proportion of motivator 
factors are mentioned as positive as opposed 
to negative reasons (р < 0001). 

(c) А greater proportion of money factors 
are mentioned as negative as opposed to 
positive reasons (№ < .0001). 


(It should also be noted that Hygiene factors 
account for significantly Sreater than 50% of 
the mentions as either positive or 


as negative 
reasons.) (5 pos < 005; p neg < 0001) 
4. Motivation Factor x Positive and Nega- 
üve Reasons x Level 
This result is highly 
most directly on 


study. To interaction it is 


1962) that the table 
tion categories of one 
in this case the posi- 
ns. It can be observed 
ion group more often 
nd less often mentions 


Motivators 
77 negative for Lows| 


- 77.6% negative for Lows 


Low-Satisfaction Group 


Fig. 1 Frequency and direction of mention f. 


low-satisfacti 
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hygiene factors as positive reasons (p < we 
than does the low-satisfaction group. oo 
mentioned as a positive reason equally s 
quently by both groups (р < 1.00). As E 
tive reasons the low-satisfaction group ү 
often mentions motivators (р < Y fi 
less often hygiene factors (p < .000 tors 
well as more often mentioning money ^ 1 
(Р < .005) in comparison with the Mg 
satisfaction group. ially 
Figure 1 summarizes the results. pesem е 
the left-hand side of the figure vum ES 
response pattern for the low-satisfac ir 
spondents while the right-hand side e ; 
pattern for the high-satisfaction Ss. sn satis 
rection of the arrow indicates, for a direc 
faction group, whether the predominan ібсап 
tion of the factor was statistically ks r 
as a positive reason (arrow points АГ) һе 
аз а negative reason (arrow points „л 
length of the arrow indicates the ‘at 
the predominant proportion. The je ncy 
the arrow reflects the relative frequ action 
mention of the factor for each 2d теп” 
group. The differences in frequency faction 
tion between the high- and ret of the 
Sroups is also reflected in the widt ative 
arrow. (Since the positive versus i 
mention of motivators for the bur x 
group is not significantly different, 
right-pointing arrows are drawn.) are pre’ 
Figure 1 indicates that motivators sitive!) 
dominantly influencing satisfaction P 


Motivators 
74.2% positive for Highs 


pigh 
А r 
Money-59. 8% negative (0 


Hygiene s 
56. 6% negative for Hig! 


High-Satisfaction Group 


Ог type of motivation factor by high- and 
9n groups, 


Two-F: R г 
ACTOR HYPOTHESIS ОЕ JoB SATISFACTION 


1 bt the high-sati " 

ou enam group, while, for the 
ive and negati group they have equal posi- 
act predomir ive influence. Hygiene factors 
асо nantly negatively for the high- 
Ssfaction) and (as reasons for incomplete 
‘or the E predominantly positively 

assiste ш (as reasons for 


Discussion 


The 
H Observ, 
Qi ere ai е eue confirm neither the 
te YDothesis a 959) hypothesis nor the 
s Significant] for this study. One result 
thy nt 9 Which h y affects the data is the 
tequently y om factors are mentioned 

mot high- and d motivator factors by 
sible ve and a ow-satisfaction Ss, both as 
explanation positive reasons. Four pos- 
alons are offered for this: | 


Per, ^ Methog р 
à Sen Unique to This Study. 
Отрапу?” в attended to the phrase 
Question. кч the stem of the open- 
‚ш r compan they interpreted this a5 
ave pe frequenc hy-policy-like responses, а 
2 БЫШ Cy of hygiene factors may 
‘Ome ti thaps 4 ee Unique to Herzberg's 
Were je we, king um to think back to 
jan tense fie ce or negative feelings 
Pj, feeetable «i spurious frequency of 
p Ors, mportant” factors. that 

i haps Job С 
ly technic СОТУ of the Respondents. 
Ming оге =<. s deem hygiene items rela- 
5; ient than accountants °F 


Ph 


eC 

a om 
чу ү! Need of the Respondents. The 
Mey, ben known h the respondents were em- 
“open to have a highly comprehen- 
чү Deq ,,D'ogram i BIA i 
Cop У ет of п addition to a ме" 
Munica ti employee-higher-manas® 
Поп and concern {ог the 
high morale. Perhaps the 
in ^^ hygiene and motivator 
e a culture is 115 
ire of company practices. 


КАШ 
lo, Te he rae 
"i th 18 а Еу of markedly un 
°у S of hygiene and motivator 
tion 


oth Е : 
do permit some predic 
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about the relativ 
те frequency 5 
classes of variables. неу о cm 
козу т would predict that mo 
ors would be relativel А 
: i» latively more freque 
кз positive reasons for абнова 7 
mpi positive reasons for low-satisfaction 
5s. he present hypothesis would make the 
same prediction. The data support this 
diction. “ 
Herzberg's hypothesis would predict that 
hygiene variables would be relatively more 
frequent as negative reasons for low-satisfac- 
tion Ss than as negative reasons for high- 
satisfaction Ss. The present hypothesis pre- 
dicts the reverse. The data support the pres- 


ent hypothesis. If hygiene factors are the 
culprits in determining negative satisfaction 
below a neutral point as one would predict 
{гот the Herzberg formulation, then dis- 


satisfied, not satisfied, employees should men- 
tion a greater proportion of them as negative 
reasons. 
The present formulation implies four other 
explicit predictions about the relative fre- 
quency of positive and negative reasons: 
es should be mentioned 
as negative than as 
igh-satisfaction Ss. 
ariables should be mentioned 
as positive than as 


-satisfaction Ss. 
tioned rela- 
as negative 


1. Hygiene variabl 
relatively more often 
positive reasons by h 

2. Hygiene v 
relatively more often 
negative reasons by low 

3. Motivators should be men 
often as positive than 


high-satisfaction Ss. 
should be men- 


tively more 
reasons by 


4. Motivator variables 
tioned relatively more often as negative than 
by Jow-satisfaction Ss. 


as positive reasons 
were confirmed 


but Prediction 4 was not; there was no sig- 
nificant difference observed. (Herzberg’s hy- 
pothesis only touches on these issues and does 
not make any explicit predictions about these 


relationships. 
Myer's (1964) interpretation extends the 


Herzberg hypothesis by maintaining that hy- 
“have little motivational value 


giene variables 
g5]” but only became important in 


pelow-neutral variance їп satis- 
motivators are absent from the 
is as if the absence of 


Predictions 1 through 3 


determining 
faction when 
job environment. It 
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TABLE 5 


SATISFACTION-SCALE RESPONSE VERSUS 


Completely 
dissatisfied 


Satisfaction-scale response 


0-3 
Nu 2 
Number of respondents | z | 
Frequency of mention of motivators 2» 29: í 
Proportion of motivators in negative direction 59°; 


motivators were not attended to as a source of 
dissatisfaction by low-satisfaction Ss. Tt is not 
clear whether the absence is suppressed, 
repressed, or loses saliency. ( There is implied 
in Myer's discussion a subtle distinction be- 
tween the absence of motivators as opposed 
to their dissatisfaction, that is, the distinction 
between achieving versus Standing still and 
between achieving versus failing. This issue 
is an extremely important one inadequately 
dealt with by all hypotheses including the 
present one.) 

If motivators are increasingly repressed, 
Suppressed, or less salient as satisfaction de- 
creases, their overall frequency of mention 
should decline, and particularly their fre- 
quency of mention as negative reasons for 
satisfaction. However, it is evident from 
Table 5 that th 


tioned in the negative direction becomes 
greater as satisfaction decreases, а finding 
directly at variance with th 


e loss-o f-saliency 
hypothesis, 


patterns of response 
to any hypothesis yet Proposed, 

It is evident that the issues which Herzberg 
raises are of extreme importance, Unfortu- 
nately, however, these basic issues have been 
spelled out rather vaguely and have been con- 
fused by many investigators. While Herz- 


FREQUENCY OF Motivators 


| 


Completely | 


FN yo 


| 
satisfied | Tot? 

9-10 
e dcs qm „ jets 
78 ит (210 s | Er 
19% |32 | sb ama) my | AF 
5160 43%1 ari 220) 16% | 95 


olt" 

berg's basic findings were that content/? 
text factors were correlated with -— 
dissatisfied attitudinal responses, ae Es 
sion of his data to the two-factor paa. 
sumes a direct equivalence between bud. 

On logical grounds there are four - jene 
patterns of relationship between the c at 
of a job factor and satisfied /dissatis 
titudinal responses: 


in 
1. А factor may be salient whei a по! 
dividual states that he is satisfied, 
Ў грн u 
pin iri when dissatisfied, b 
not when satisfied. isfied and 
3. It may be salient both when satis 
when dissatisfied. when 


4. It may not emerge as salient ae au 
the individual is satisfied or whe 
dissatisfied. m. 
indicat”? 
Herzberg interprets his data as gp hy” 
that motivators fit the first pattern P con 
giene variables the second pattern. is go 
struct he employs to explain ory nat 
primarily on a moral definition of the ^^ ar 


being ing 
of man and an analogy (Human ай?! 
se 


7 О actual? у. 
essentially characterized as pe à s 
organisms and anything which ОКЕ, i p 
actualizer acts as a hygienic fa ig 1 


construct seems a trifle ad hoc ie е 
coordinated to тоге basic psy gor 
variables. vide uL 
А more powerful theory would Lom ju 
the prediction of all possible ie fac йл 
Satisfier patterns for any given jo varia) 
any cultural setting. It is felt that ie 199^. 
of the Social Learning Theory (Rot 
meets these requirements. А 
The basic function would state: | 


Occ — Exp 
HV-f Е Lies 4 
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Where: 
БИ = Hedonic Value: an index of the 
negative dire me factor in a positive or 
è an index irm Thus, in effect this would 
Serves as a of the extent to which the factor 
Übrtenent tere or dissatisfier. RV = Re- 
Measure of = or Valence: basically a 
actor with the relative importance of the 
ndividual’s керен i other factors in the 
~LO < Rp system of work goals, where: 
Occurrence T + 1.0. Occ = The extent of the 
е stat reinforcement for a factor: this 
Ча Sing] = as a decimal which in instances 
at m reinforcement can take on values 
Oce sa? and where —1.0 < Occ € +10. 
“perience ection of the individual's prior 
Actor, p. Sit regard to the particular job 
осе = The subjective probability of 
| 0, This ent for the factor: —1.0 < Exp € 
ibe z5 essentially an expectancy vari- 
Number i tia function of the frequency 
ing jo Si aa experiences with regard 
ll alities į or under consideration- As the 
Bically а indicate, RV, Occ, and Exp can 
an odale factors viewed in a 
G ative gi п by taking on either positive 
Nsider gns. 
In кетеп 5 ап example the motivator of 
ing; "Ins of p promotion in the organization. 
«ү tal viey as predictive function, if an 
to lie " WS his probability of advance 
b a ! à continuum from no advance 
he оша Vancement, his expectations 0" 
Oh сез his : Positive. If, on the other hand, 
deme ;S nti bility of advancement to lie 
ise „бур op from no advancement (0 
№ Vilar]. О Would be negative. 
Se, 06 positive if 
tin › that is, if the reinforcement 
f " Inuum from no advancemen 
des Ce en Nt. Occ would be negative if the 
s on. t were from no advancement t° 


in fact 


y. . 

bet | y Promotion represented à valued 
iew, dividual, RV would be positive: 
а promotion as undesirable ОГ 
$ Ot some reason, RV would be 
NON is Biss 1 

К пот nt E e example of promotion oF 
А зп ‘te might possibly be viewed as 
чар x p of time since last promo" 
Slast з Ога short period since an in- 
Promotion N would be large, an 
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for a long period N would be small. An expres- 
1 

| years since last promotion 
might adequately describe the variable in 
this instance. This merely accommodates the 
fact that valued reward for the “hungry” 
man has more impact than reward for the 
satisfied individual. 

By inserting various assumed values for 
these variables into the function, one can 
identify those sets of conditions under which 
a particular work-content or -context factor 
can be expected to serve as а satisfier, and 
when as a dissatisfier. This type of model 
ediction to the satisfied /dissatisfied 
from pertinent basic psychological 
th the content/context 
factors. Table 6 summarizes the predictions 
which would flow from most of the pertinent 
tations of the variables in the model. 
of +1, 0, or —1 for RV, 
Occ, and Exp, and assuming the N term to 
be a constant equal to 1, HV could range in 
value between —2 and +2—the “motivator” 
of advancement could conceivably range from 
being a strong dissatisfier (HV = —2) through 
a position of indifference (HV =0) to a 


sion such as V 


permits pri 
dimension 
variables associated wi 


permu 
Assuming values 


TABLE 6 
SIGNIFICANT PERMUTATIONS OF RV, Occ, AND Exp 
—————— <== — = 
Possible values Result- | 
„—= ant Explanation 
T m v | 
RV | Occ | EXP | H | | 
eem p nex! d fortune 
} -1| +2 Unexpected goo 
2 2 | +1 +2 | Unexpected good fortune 
zi +1 | 0 +1 Gratuitous reward 
И 1 0] + | Gratuitous reward _ 
Ki E —1 | H | Unfounded apprehensions 
d o| +1 +1 Unfounded apprehensions 
« 1 | +1 0 |А completely predictable 
a1) + | outcome 
| 0 o | No experience 
+1 : | +1 | 0 | Indifference | 
0 | A | d | 0 |А completely predictable 
&t[7! | outcome . 
| +1] —1 Unfulfilled expectations 
Mtr S | a] —1 Unfulfilled expectations 
"e | X | бү -1 Unexpected loss 
ud +1 E of] = Unexpected loss — 
a | +1 —2 | Complete reversal in 
mI | expected valued outcome 
| | 1 2 |Complete reversal in 
ud ios i r lued 
expected valued outcome 
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strong satisfier (HV = +2), depending upon 
the importance an individual attaches to pro- 
motion, whether or not promotion occurs, 
and his prior expectations of advancement. 


In this example, the value of 

1 
N = years since last promotion 
would inflate the value of HV for individuals 
with a relatively long period of time since 
last reinforcement and reduce it for the 
recently promoted man. This experience vari- 
able is intuitively an important component 
of job satisfaction which is omitted from 
most models. 

Beyond the example dealing with advance- 
ment, a similar rationale could be applied to 
any of the other content or context factors 
discussed by Herzberg, as well as to addi- 
tional components of the work environment. 

Although the validity of this specific model 
has not yet been empirically demonstrated, it 
is amenable to test, and data are currently 
being collected within this framework. 
Whether or not this exact function explains 
industrial job-satisfaction data, it is hoped 
that this discussion has highlighted some of 
the pitfalls in assuming a simple equivalency 
between content/context factors and satisfied / 
dissatisfied response patterns and that it 
presents some of the more basic variables 
Which have to be considered, In short, it is 
believed that the relationship between 
ward value, reward occurrence, reward 
pectancy, and frequency of similar 
will better predict the positive or 
fluence of individual job factors 
job satisfaction. 
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Ves; PUtpose ç 


b 
Фр 
ite 
an the criticis | | 
3 iticisms of numerous journal- 
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psychologists, 
cor- 
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a or 
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d. for а developed through. 1t 
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€ but imm explanations for 
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ompanies, ranging 
sample, Ss were cast into 
s managers ratings. The 5 
bject to the K correction 
e expected direc- 
n the publisher's 
у statistically sig- 
and was not 


upon sale 


1 scale, 


instruments work despite the fact that they 
can be faked; or (5) they work because they 


can be íaked. The present authors are 
strongly convinced that the weight of the 
evidence is for the latter explanation. This 
needs some amplification. It is the authors’ 
hypothesis that the good salesman is more 
likely than the poor salesman to have a cleat 


conception of what demands the selling job 
puts on him person 


ality-wise, and hence !5 
better able than the poor salesman to put his 
best foot forward, regardless of what his “true” 
personality dynamics really are. The present 


e named this hypothetical con- 


authors hav 
Their 


struct “JID,” job-image discrepancy 
contention is that salesmen, especially, will 
they think the 


give the answers 
ce their responses be- 


attempt to g 
asure of their 


come to 
image of the job's 
what Gellermann ( 
deception.” 
However. 
as used by 6 
pens in the re 
all-out а 
(Ss) аге instru 
experiment “that 
1962). 


“sensible deception” concept 
an to describe what hap- 
tion is not the same 
fake when subjects 
as part of an 
(Dunnette 


the 
ellerm: 
al-life situa 
ttempt to 
icted to do so 
doesn’t count” 
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What, then, does K measure for job ap- 
plicants? In reviewing the literature, Dahl- 
strom and Welsh (1960) conclude that: 


The picture [of high К normals] is one of poise, re- 
serve, and comíort in social relations. These people 
usually have the social skills and experience to carry 
off successfully the moment-to-moment requirements 
of a social situation, or if they have qualms 
and insecurities, to cover them under a fagade of 
imperturbability [p. 144]. 


This statement could easily be a description 
of the successful salesman! 

The K scale is also a measure of the extent 
to which a testee gives socially acceptable 
responses. In the normal counseling situation, 
there will be a wide range of test-taking at- 
titudes. Some Ss will be extremely honest and 
frank; some will be extremely defensive. By 
measuring this attitude with the K scale and 
correcting the clinical scales for this test- 
taking attitude the authors of the MMPI feel 
that the discriminatory power will be sharp- 
ened (Hathaway & McKinley, 1951). How- 
ever, it is reasonable to assume that the 
variability in test-taking attitude among job 
applicants is much less than among counseling 
cases. The former are motivated to “look 
good” to the employer. It is hypothesized 
that the good salesman will succeed better 
in giving the “right” answers because his job 
image is less discrepant. If this hypothesis 
is true, the function of K correction would 
be to suppress validity rather than test-taking 
attitude. 

In the present study, the specific hypothesis 
was that the K correction will reduce the 
validity of the five clinical scales to which it 
is applicable. A presupposition, also tested, 


was that the uncorrected scales are correlated 
with selling effectiveness. 
j METHOD 
Subjects. The sample consisted of 182 presently 
employed sales representatives from nine different 
organizations. All were in industrial rather than 
consumer sales; that is, the customers were business- 
men, not members of the general public. 
Procedure. As part of a larger battery, the MMPI 
was administered to Ss while they were employed 
with their respective companies. Although the 
primary purpose of the testing was to establish 
standards against which to evaluate future ap- 
plicants, Ss were told that test results would be re- 
ported to management, as indeed they were. It was 
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felt that this was sufficient motivation to cause $ 
to answer the questions as they would, had E 
been applicants. Prior to taking the battery, 55 E y 
a sheet entitled, “Why Take Tests?” which Mo 
described the purpose of testing. Part of the descri 

tion of the temperament tests was as follows: 


In taking tests of this sort, it is particula? 
important to describe yourself as accurately ty 
you can. People have a natural tendency t9 е of 
their best foot forward.” This is especially we 5 
salesmen, who quite properly sell епохе iy 
well as their products or services. If this ten it i 
is too extreme, the results will be dici 
interpret. For this reason the tests contain . 
number of cross checks. These and 
detector" features determine the extent t9 
a person has tried to “beat the tests.” 


which 


ty 
anageme” 
Before test results were reported to тапар ives 
Ss’ superiors rated them into upper and lower ^ 


А jobs. 
based upon total effectiveness in their present J 


ANALYSIS AND RESULTS 


pr 
The analysis was based on the five Maing 


scales which are usually adjusted by &° are 
a proportion of the K score. These scales pir 
Hypochondriasis, Psychopathic Deviate, ania 
chasthenia, Schizophrenia, and al i 
The keying is such that high scores a 
dicative of psychopathy. «po 
The first question to be answered was», fer 
these scales, without the K correction, ©, As 
entiate between good and poor salesme" 
parametric tests do not apply 
markedly skewed distributions, the e 
Whitney U test was employed. The eh 
pooled into two groups— better and P 
salesmen. A one-tailed test was used; gales” 
hypothesis being rejected if the better mal) 
men had significantly lower (тоге 10 


TABLE 1 ЕЕЕ 
Я FFP 
RESULTS ОР MaNn-Wuityey U Test or D! ЕХ 
TIATION BETWEEN Соор AND Poor SA 


£$ 

FOR UNCORRECTED MMPI CLINICAL Ser 

Scale 2 
Hypochondriasis 1 67. 
Psychopathic Deviate 321. 
Psychasthenia 248. 
Schizophrenia 2.67 
Hypomania 1.89 
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бөрк TABLE 2 
MPARISON OF RELATIVE PERF х Ч 
E и ! ERFORMANCE ON CORRECTED AND UNCORRECTED SCALES 
- ror GOOD AND POOR SALESMEN 
Scale и ra - | 
Criterion | Better (lower) | Better (lower) 
" on uncorrected on corrected x Direction 
Good | 56 | 3 
3 ior Е | а aet Uncorrected scale more valid 
Good | 
i 60 27 3 J 
á Tos p pa 3:2" Uncorrected scale more valid 
Good 5 à 
m 51 34 0597 Uncorrected scale vali 
1 : e E more valid 
Good 
А cu F z ggat Uncorrected scale more valid 
Good 
OR ar E: 0.6 Uncorrected scale more valid 
Ma „Мои 
= ңу А = = 
Hynomama tations: Hs = Ну iasi à à ; 
a Tu "i ypochondriasis: ра = psychopathic Deviate; P! = Psychasthenia ; Sc = Schizophrenia; 
"a E 
Seo 
Tes 
the predictors and the criterion?" Due to the 


Sales Аз car 
better if oe seen in Table 1, all five 
tiga, and Somer i differentiated between 
ance levels rer salesmen at accepted sig- 

tthe 1 

Doe, Second 
these the к — to be answered was, 
lih, € Scales ctor, when used to correct 
as recommended in the pub- 


marked skewness 
tions, all pre 
tetrachoric СОГ 
criterion Was 
(that is, wit 


of sever 


al of the distribu- 
dichotomized an 
mputed. Since the 


established within subsamples 


the predictors 


Dreqi S man à 
her Wve =" increase: 07 decrease their heir 
hay, Ss TS > Tf the correction indeed The Ss were then pooled into 101. 
ity, the better salesmen woul Tables 3 gives the validity coefficients (tetra 
choric correlation) for K and for the correcte 


за]. Cati 
Sten vel 
y lower scores and the poorer 


Cop wen 

tecti relati | 

нп Was vele higher scores 
i applied. To test this, the 


nq Ww 2 
М; entire 
NSW rank 1 
we is Out tae d on each scale, both with scales are high enous : 
n d af K correction. For each of the battery. The / correction, however, Te 
oie Hting e i table was constructed duces these validities to the point where they 
wed vta did of the criterion groups into are essentially 210: 
e 9 dia Wer) on relatively better at is, — 
que relativ, к, corrected scale and those — -— | 
qi * e2 d. better on the uncorrecte TeraACHORIC УАР — 
et »" levels ( — ре chi-square Scale Uncorrected Corrected 
Pk oS of si 5 (two-tailed tests), and the 
N Menge ПЕР, For all five scales, К 39* =, 
ifea Pte a actually decreased validity- ochondriasis |. at m 
Re it for p this was statistically P e 27 Rr 
9 n Ne sy | 

К fi Опе s ipe, approached signi" Schizophrenia — 24 10 
"we s . cale, and was not significan Tiypomania 10 07 
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ap Лай 
uesti LN = 182. 
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test the hypothesis that drivers with 
nt, the low-accident, the high-violator. 
y different characteristics when 
ted car. The device used in collecting 
digital form: (a) driver control actions, 
ents. The measurements were taken over 
revealed significant differences between 
about 2 in 3, Con- 
hnique offers an im- 


r ngful, and that group and 
individual classifications of drivers may be 
obtained by multivariate analysis of these 
measurements. This study is based on the hy- 
pothesis that drivers with different accident 
experience and driving records exhibit differ- 
ent driving profiles in ordinary driving. 

An earlier study (Greenshields, 1963) sug- 
gested that it is possible to record and identify 
driving patterns and hence classify drivers. 
This study is essentially à repetition of the 
first, conducted with more reliable equipment 
and more refined techniques. 


namics, are meanit 


Trsr PROCEDURES 
ё established on the 


ires wer! 
e certain basic 


Testing procedu 
assumption that drivers hav 
characteristics related to their abilities and 
their physical and psychological traits. It was 
recognized that a driver’s performance un- 
doubtedly changes from time to time, but it 
was believed that drivers with proper instruc- 


tion. designed to not only inform them but 
sentially 


put them at ease, would perform es 
at their norm. The good student passes his 
th consistently high grades. 


examinations wi 
The superior at 
during à “slump. 


hlete is still superior even 


METHODS OF RECORDING EVENTS 


Events recorded were: 


Vehicle in front oft 
Total traffic density 
(a) Vehicle in front of test car. 


(b) Car passing on left 


1 est car 
around the vehicle: 
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(c) Car passing оп right. 
(d)-(1) Pedestrians crossing, etc. 
- Total trip time. 
. Running time (car in motion). 
- Delay time—total time minus running time. 
- Amount of speed change. 
- Amount of direction change. 
- Acceleration reversals, 
- Brake applications. 
10. “Gross” steering-wheel reversals. 
11. “Micro” steering-wheel reversals, 
12. “Micro” steering-wheel reversal rate, 


о 00 м о сл pw 


fixed events in- 
as curbs, signs, 
and buildings. Since all drivers 
route the fixed events were not 
recorded. The variable events included all vehicles 


and pedestrians whether moving, standing, or parked. 
In the enumeration of events, it was reasoned 


_All of the data on 
tions, etc., were recorded 


total trip time, Tunning time (ti 
delay time (total time minu 


by an 
mounted under dash. The i 


at 2-mph intervals for either an incr 
crease in speed. Amount of di 
obtained by electric impulses Supplied from 4 
compass to a counter for each 24° 
tion. 


Eyro 
Change in direc- 
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An accelerator reversal amounting to iin. up ai 
down movement from any position was recor | 
The number oí brake applications was recor 
The “macro” steering-wheel reversals were ering 
amounting to about 81° of turn of the er 
Wheel. This is about the amount of turning nec cat 
to produce a noticeable change in direction of 4 A 
The “micro” steering-wheel reversals were | 
amounting to 23? of turn of the steering bus. ov 

In the collection of data, care was taken m 0 
the same Procedure on all test runs. Instruct ot 
the drivers were read in order that they wou 
vary. Only one research assistant accompa о 
driver. Every effort was made to put the inar) 
ease. He was not taking a test in the "спай. 
sense for there would be no reward and no Pituall 
He was to drive over the speed limit if he ha 
drove that way, her with 

The runs were all made in good were with 
dry pavement in a 1962 car (Ford у ы mid 
automatic shift, during the midmorning солар? 
afternoon hours when the traffic flow was re mu 
Constant. The О, however, recorded the 
density. t 

Drivers were tested in each class through wes 
months taken to complete the field work. ‚ min 
done in order to eliminate the effects of апу aso" 
changes in vehicle characteristics, route, [m egi 
changes, However, a larger percentage of i month 
ning-driver runs were made during the A on е: 
of testing than were the other groups be 
scheduling Problems, 


Test ROUTE sisti" 
The test route selected was 17.0 mi. long f exprt 
of approximately 6.4 mi. of rural, 5.1 ml. E mi. 0 
Way, 2.0 mi, of commercial (downtown); si en” 
industrial, and 1.5 mi, of (high-density) Тү 
The average running time was approximately ype 
about equally divided in time for each 
roadway. 


SELECTION oF DRIVERS jve 

nt "m 

To establish a standard of measuremms e Ton 
With better than average records were S€ ddi s 
the lists supplied by an insurance agent uctor rds 
to these, a group of driver-training in$ ec! 0 


med 
Screened; only those with the best ШО, 1 
Were used. These two groups were sie 
furnish the control group (CG) compo еп 
driver-education teachers and 23 low-ac jn 
perienced drivers, t HA) 
A sample of 40 drivers (high acciden se E 
jeopardy of losing their insurance bec the ра? 
many accidents was selected at random fro ог? anf 
of an insurance agent. Individuals with nfl? 
three violations were eliminated to avol 
with the high-violation (HV) group. 10 
A high-violation (HV) group was а n 
Twenty drivers with over 12 МЕМ gon 
acquired in 2 yr, (sufficient for rev? 


1 


wi 
габ 
d int 


of 


{OC åq TM 


PREDICTI 
NG ACCIDENTS AN 
AND TRAFFIC VIOLATIONS 


TABLE 1 


Description OF GROUPS— AVERAGES 


Descripti E, . 
ption Control group High accident к gi 

F High violati = 
Age —-— (40 drivers) (40 drivers) (20 PT Beginning 
Percentage | Е | | (40 drivers) 
Driving = of males | E | 43.2 25.0 | 16 
Mi хрегї 3 | 806; i 5 
чы iive] EE (in years) 21 К | 80.0% 90.06 19 сы 
No, асс УС last уса х | 22.9 5.0% 
Vi йн ү face 5 | ы, 10.4 21 
йолу s in 4 yr, n 15,750 18,500 23 mo 
“eentage її points) over 4 yr. | 00088 30 0.85 

of zero violations — | 025 1.7 13 
a | 80 60 n | 


lic 


ens, 
by 0) Were se 


T. 1 
\ ecte ; Р 
T not Seas Their accident records, how- 

eginning AARTE 
ool е n (BD) who had passed 
" иса 4 H " Б 
eq, 1901805 not canon and had their Michigan 
Qu id ore than 3 mo. were also 
Andon, Pend 

en n Ё 
the н, from the aye of drivers was selected at 
ШҮ җы аа basic groups and not used in 
dfi lest the SI The independent sample was 
“tt qp eds and ud of the discriminant-function 
шо айо of pt н predicting the cor- 
thee, ation à single driver 

Se p On age, sex E x 

froups js E. i SES, driving experience, etc., 
Shown in Table 1. 


бш bje муан or DATA 

cti cto " 

Vou On of a py analysis was to find some 

ferent discrimin et of driving variables that 

analy , Classes [o between drivers of the dif- 

уе Method he particular multivariate- 

los, Story an PM is known as “dis- 

Ver (Com alysis [Bennett & Franklin. 
) Puter Program Bimed. No. 005 


anal 

е Yzin 

te, pet all piss data, since the variables 

Majo, Was aei independent of each 

ingle i of part EE. to suspect that а com- 
d ; of them could be more €* 


Vivis d discrimi 
ia rte 5 Тар Шацы between the sets 0 
ay td T reason E eger of all of them. 
Oye t © method shi combinations were 
Teg, йїп Variab] ollowed consisted in using 
ч л Пе а re for a first trial and then 
of able. re ane at a time until best 
RAM Bave E In several cases fewer 
agile, i ? а did good or better а separation 
(olent ^ iscrin а larger number. For ex 
NO), f ninating between the high- 
ton we var DS and the control group 
уы ie gave as good à discrimi- 
groups as did six variables. 


To illustrate using Variables 2, 4, 8, 10, 11 
and 12 to discriminate between the ү 
groups, they were found to be different at a 
level of confidence of 97.5% (level of sig- 
nificance 2.5%). Using Variables 2, 4, 8, 10 
and 11, the level of confidence was 99.076. ' 

The results of analyses runs to determine 
f discrimination be- 
d the number of variables 


tween groups an 
m levels of significance 


used to give maximu 
are shown in Table 2. 

Comments: 

(a) It is to be noted 
that have high significance in the com| 
between any two groups are: 
sity. 4. Running time. 8. Ac- 
15. 10. Gross steering Te- 
eering reversals. 


that the five variables 
parisons 


2. Traffic den 
celerator reversa 
versals. 11. Fine st 
tion of the HA group or 


(b) For discrimina 
the HV group compared to the drivers with 
TABLE 2 
SIGNIFICANT LEVELS OF DIFFERENCES 
IN DRIVING BEHAVIOR 
F ГА 

СС versus HV 

à pass) = 3.5207 | 25 


Variables 4, 8, 10, 11 


CG versus H^ 
Variables 4, 

HV versus D 
8, 10, 11 


g, 10, 11 F (4/75) = 8.4817 | 0.1 


F (4/55) = 6.2808 | 0.1 


Variables 4, 
HV versus HA 
Variables 2,48 10, 11 
HA versus B 


Variables 4, 


F(5/54) = 2.3090 | 10.0 


8, 10, 11 Г(4/75) = 15.0182 0.1 


~G = control group; HV = high 
lent; BD = beginning drivers. i 


Abbreviations 
А = high accid 


TABLE 3 


PERCENTAGE ОЕ Drivers CORRECTLY 
GROUPED ny RANKING 


| Percentage 
Group N | Group N | correctly 
| | | placed 
Control 40 | Beginning | 40 
Control 30 | High violation 20 


Control 
Beginning 
High accident 
High accident | 40 


40 | High accident 40 | 
40 | High violation 20 
High violation | 20 | 
Beginning | 40 


good records (CG), the following four vari- 
ables can be used: 


4. Running time. 8. Accelerator reversals, 
10. Gross steering reversals, 11. Fine steer- 
ing reversals, 


The variables are 
categories relating to 
(c) vehicle motions, 
movements, 

It seems reasonable to expect th 
one variable will be 
for discrimination of 
The final selection of 


logically divided into 
(а) traffic, (5) time, 
and (d) driver-control 


at at least 
needed in each category 
driver's characteristics, 
five variables gives one 
in traffic (No. 2), one in time (No. 1), none 
in vehicle motions, and three in driver-contro] 
motions (Nos, 8, 10, 11). 
It is reassuring to note that these five vari- 
ables have about the same high confidence 


level when Comparing any combination of 
drivers, 
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T 
It it interesting. that: (a) Traffic du. 
(2) is a factor of some importance only y 
comparing beginning drivers with the nis 
groups. (b) The wvehicle-motion үн i 
drop out, probably because speed hag е 
related to accelerator and brake i е; 
in this particular type of experimental me! 
speed change is apparently not an S nd 
parameter compared to the driver-c 
movements, 


VERS 
CLASSIFICATION oF INDIVIDUAL DRI 


rity 

Up to this point, for the sake of qus 
the discussion has been confined to ums 
criminant” Separation of drivers into ede 
or classes, and no attempt has been тг 
classify drivers on an individual wr using 

But one of the primary reasons i as 
the multivariate-analysis method ae nat it 
the Discriminate Analysis Method Ч to one 
permits an individual to be assigne¢ the fact 
of two populations. This follows from livi ual 
that all Y values or scores for each Pe or 
as found in analysis may be arranged Í р 
of rank. tirely dif- 

If two groups of drivers were en soul 
ferent, then all X scores for one grouP or the 
fall in one range and all the Х - m range 
other group would fall in a ae! y dif 
But since the groups were not entirely к 
ferent there was overlapping. ‚ ranki”? 

The results of comparing groups by | 
are shown in Table 3. ‘ven it ab 

According to the analyses just gv < in : 
pears to be possible to place drivers 


TABLE 4 
DISCRIMINATORY ANALYSIS ОЕ EXPERIENCED DRIVERS vERSUS BEGINNING DRIVERS = —7 

ТЫШЫ е лоно Dart io 

Classification Control group Beginning drivers ied di 
No. tests "umm | 40 197 
Traffic density (2) 4555.65 | 5730.05 ge 
Running time (4) 1774.15 | 1806.80 MT 
Accelerator reversal (8) 72.87 | 76.37 aant 
Macro steering reversals (10) 565.02 | 64417 АЛ 
Micro steering reversals (11) 1078.65 1189.47 00: 


Mean X —.0381492 
Variance 156796 » 10 з 
SD 


+.0125132 


Note, № = 40 for each group, Ft 
Discriminant function coefficient, 


5/74) = 3.21160131, Level of signi 


—.0191403 | 
-122118 x 10:3 
zk.01104572 


ficance — 1.0% (Level of confidence 


"s 


= 99.0%) 


PREDI q А 
:DICTING ACCIDEN 
$ NTS AND Tmarric Vio 
AFFI! IOLATION 
2 NS 


м TABLE 5 
"—- ETHOD FOR OBTAINING THE X SCORE FOR THE NEW DR 
- й 2 IVER 
Driving variable Dat 
= ata DFC 
density 
Runnin жер 
A g time dO» X ( L8246 X 10 
Кш ve X (—0.9240 X 1075) = —5 
see ne y | 1620 x ( 1.8246 X e 5286.2010 x 10-5 
Mice steering reve sis (10) SG X (салкы X 1079) s 1: 
ee s ) 686 X (— 4.4884 x 10-5 — 42.2212 X 105 
ersals (11) 966 X (—0.0515 X 107) = peces X 10 
= —49.7 x 1075 
X = —5484.9432 X 1075 
or —.05484943 


^Di 
Iscrimi; 
Minant function 


coefficient. 


Dr 
time ted aroun 
Pi This was pri least two-thirds of the 
мер ops. ү оң by comparing 
timi Ж зың е question is that of 
Com ШЕ Unetion c e tà employ the dis- 
dri, aring grou 1 coefficients, established by 
Cally 5 Outside ps of drivers to individual 
begin for exam ев groups? Моге specifi- 
Over p 08 dips: e, is it possible to select a 
Whether Drescriby с random, test his driving 
Broup ^ his divin test course, and determine 
Or in t ing ability is in the beginning 
h illustrate солт. group | 
ee method of determining 
Ategory m driver will fall into the 
б = select a beginning 
est drive ta tested and ascertain 
Into the ня aces him in the beginning 
е Previous| наи group. 
2 8 are Fd established discriminant 
^ vn in the last column of 


or 


н 
To 
Ut 


У 
for 


К ул 
nt a between the two means. 

бү Peete midpoint (noting 
п. Ува TM distribution of the ex- 
сей js LR Pd 012513 and for the 
900125 :011046) is equal to: 

513 = 13) 
(о 911046) X — 049140 


Sy 
4 
38149) " 


М 


— 038149) = — 043987. 


: : ss than —.043987 is in the 
inexperienced group and any X value greater 
than this is in the experienced group. The X 
value of —.548494 being less than — 043987 
is in the inexperienced or beginning group 
where it should be. The farther away the X 
value is from the value —.043987, the more 
assurance that it is one group or the other. 
Using this method the results shown in 


Table 6 were obtained. 


Any X value le 


DISCUSSION OF RESULTS 
niques described in 


The methods and tech 
nsion to the under- 


this report add a new dime 
standing of driving behavior. Apparently 
there is revealed in ordinary driving those 
behavior patterns that lead to safety or prob- 
ability of mishaps on the highway. 

The initial series of tests showed significant 
differences. between groups of drivers. The 
second series of tests, over а new course and 
with different drivers, has confirmed these 
results and indicated a high degree of con- 
fidence in the discrimination between the dif- 
ferent groups an ification of individ- 


d an identi 
ual drivers to a much higher degree of reli- 


TABLE 6 
CLASSIFICATION or INDIVIDUAL DRIVERS 
<= = 


— 
No. pre- preselected | No. Percentage 
selected | — category placed in correctly 
drivers | T | category | placed 
a Е 0—7 јара 

20 Beginning 14 | 70% 
8 High violation 8 100°, 
8 Low violation 6 256 
9 High accident 6 
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ability than obtained by any other test pro- 
cedure known to the authors. 

Complete reliability is hardly to be ex- 
pected. One should expect some overlapping 
in performance scores. Chance plays such an 
important role in a driver's record that it is 
always difficult to determine whether the dif- 
ference between driver experiences is due to 
chance or whether it is due to performance. 
The high-accident driver may have had an 
abnormal degree of poor luck. With this in 
mind, the overlapping of the scores by about 
one-third is not surprising, 

In setting up standard scores on a given 
course, for example, one could use only the 
lowest 50% of the scores of the high-accident 
group and the highest 50% of the scores in 
the low-accident Sroup. If this was done, the 
populations, їп this case, would be com- 
pletely separate and nonoverlapping. Using a 
scale established by this method, one could 


test a new driver and classify him with good 
assurance, 


greater is the risk and, hence, motivation of 
the driver to perform at his best. But there is 
a limit to a Particular driver's performance 
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ability. The studies have shown that the 
experienced driver and the driver with “Р 
record generally makes more reversals 0 a 
controls which probably results from wae 
rection and indecision. This means that than 
drivers are working closer to their limits E. 
others. When an unexpected event um by 
quiring an additional judgment or ear Ё 
the inexperienced driver, there is less than 
hood that he can cope with the situation ; 
can the driver who is performing well w 
the limits of his capability. privo 

More research is needed with the ding 
meter—a device for measuring and ym 
driver behavior. The nature of the ye je 
clearly reveals that drivers should be oe 
over a long period of time. What happe can 
driver’s habits in 5 years? What ыш iver 
achieved by studying other groups ve песе" 
and by refining the control group? It is other 
sary to know the answer to these an 
questions. pas be 

It is hoped that a new avenue ing Ш 
opened up to safer highways. Trave put th 
avenue may be long and difficult, 
rewards could be great. 
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CAN COM 
OMPUTERS WRITE COLLEGE ADMISSIONS TESTS? 


JAMES М. RICHARDS, Jr. 


American College Testing Program, Iowa City, Iowa 


For 

many у Y gi 

di E years psychological tests have been 
m ts have assembled existing items in 


examinati i 
inations. This study goes beyond these ear] 
=. A computer procedure for writing verbal 


NE EAA 
рү of computer item writing. 
prehension items was develope 


tog E н 
Ds with the Wide Range Vocabulary Ti 
wa freshmen. The test intercorrelations, 


grades i inct 
s suggest that, in principle, computers can Wi 
itten tests are considered. 


Pos: з : : 
ssible objections to computer-Wri 


Fo 

rm 

chi an T 

hin, Y years, objective tests and ma- 


* proc 

of human ps have been reducing the role 
a achievement in measuring the aptitude 
ч applicatio of students. The first large- 
ты йде А of machines in testing, of 
o Sent. aq the scoring of tests. With 
in Oring n i DM in the technology 
du ae it is now possible to score 

| ene tests of several hundred 
Rock nation, In ia who took a nation-wide 
simul (1965) ee а of machines, 
е the bel Shown that computers can 

Drop S in Mis ul of human test de- 
hag erties fro embling a test with specified 
реу OWN rd an item file; Page (1966) 
(10645 б бла, computers can score some 
for w, Вав oe and Osburn 
iti eloped a computer procedure 


n М 
лесе rustic problems. 
lr E memor, E , Supplementary, random- 
Vices ро eae have been developed 
Multi also sug he characteristics of such de- 
Pun Pese pe the possibility of writing 
de 9 ve test items on a computer. The 
е wn ы езеш study, therefore, Was to 
Com, ing мг іп principle, some tests 
Puters ege applicants can be written 
al Ойу 
Cegg ОЁ ша is probably the test 
T alle ul for predicting academic 
re ite oa An attempt was made, 
Sy, S. des. E procedure that а com- 
Ми Shy, есіп са], write verbal comprehension 
Мы Dra items у, a procedure for writing 
Vend Sa б developed. А synonyms 
> and od measure of verbal com- 
the use of the Wide Range 
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scored by machines, and recently 
to tests and have scored essay 
lier techniques and explores the 


d and used to write a 72-item test. This test. 
, 


est, was administered to University 
reliabilities, and correlations with 
rite college admissions tests. 


Vocabulary Test (WRVT) from the Educa- 
tional Testing Service Factor Kit made it 
possible to compare а machine-written syno- 
nyms test with a factorially pure synonyms 


test written by humans. 
CoMPUTER PROCEDURE 


It is relatively easy to develop а procedure for 
choosing a stem and a correct alternative. One 
merely stores à dictionary of synonyms jn a sup- 
plementary memory device, generates à random num- 
ber, and uses this number to select a word to be the 
ther random number 
e synonyms for the 
the stem word is 
it is necessary to 
t is necessary to 
e item be- 


and uses it to se 
stem as the correct 
more than one par 
choose one part of 
choose one part at random for use in th 
fore choosing the correct alternative. 
Just this exact procedure was used to pick stem 
words and correct alternatives in the present study. 
Since no computer with a large supplementary 
memory device was available, the actual operation 
of the computer was simulated. The simulation was 
rigorous, however, an items corresponded ex- 
actly to what wou itten by à computer. 
This simulation used one of the oldest random-access 
supplementary memory devices—namely, à book. 
Although using а real computer to accomplish this 
i considerable amount of work, 
e large amount of 
red in memory rather than how 
the computer. Therefore, it is the 


k that would be assigned to à junior 


t of speech, 
speech, and i 


sort of tas 
programmer. 
After a ste 
obviously the nex 
alternatives (ies 
clear that developing 
ing distractors is the mosi 
tests on a computer. Indeed 
ture, after this problem became 
that distractor alternatives are litt 
little understood and are perhaps t 


correct alternative were chosen, 
s to choose “distractor” 
wrong answers). ]t soon became 
a sensible procedure for choos- 
t difficult problem in writing 
1, a perusal of the litera- 
obvious, suggested 
le investigated and 
he most important 


m and 
t step Wa 


TABLE 1 


МЕАХ, STANDARD Deviatio 
VALIDITY, AND INTERCORRELATI 
RANGE VOCABULARY Test 
COMPUTER-WRITTE 


RELIABILITY, 
or WIDE 


Males Females 


Test (М = 599) | (N 2 613) 


Wide Range Vocabulary Test 


То. items 48 48 
yo em 23.74 2516 
SD 6.44 6.42 
K-R 21 reliability A3 | 43 
Correlation with first- | | 

semester GPA | 30 30 
Computer-written test 
No. items 
M 
SD 


K-R 21 reliability 
Correlation with first- 
semester GPA 30 


32 

Tntercorrelation of two tests 62 64 
Intercorrelation corrected 
for unreliability of both 

tests 94 OS 


neglected Problem in the construction of multiple- 
choice tests, Most writers on test development 
Merely suggest that the item Writer must use his 
judgment and ingenuity in choosing distractors, 
Since computers have neither judgment nor ingenuity, 
such advice was useless for the Present study. 

The problem of distractors for s 
Was solved in the following way. 
provides a Classification Scheme 
in which each Word is categorized into one or more 
categories. Numbers are assigned to these categories 
of meaning in accordance with ап overall conceptual 
scheme, In the present Study, the basic procedure 
for picking distractors Was to choose randomly from 


Words in adjacent Categories jn the 
scheme, 


More Specifically 


Упопутѕ items 
Roget's Thesaurus 
for word Meanings 


Thesaurus 


» the numerica] Code or, in other 
Words, the Category of meaning, shareg by the stem 


and the correct alternative Was determined. If more 
than one numerical со 


ber was fenerated ап 5 
codes. The procedure 
code as a *tep in pick 
categories consisted of adding 
from the code number for the stem and correct 
alternative, A random number determined the choice 
between addition or subtraction, Then the distractor 
was chosen at random from words with the modified 
code number and of the appropriate part of Speech. 
A check was then made to determine Whether the 
distractor had алу code numbers in Соттоп with 
either the stem or the correct alternative, Tf 50, a new 
distractor was chosen at random. Additional dis- 


5 adjacent 
1 to or Subtracting 1 
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of 

tractors were chosen by repeating the poet 
modifying the code number and choosing a woes 
at random. Thus, the first distractor л " 
from words one category away from the ы aways 
second distractor from words two categori words in 
etc. In а few instances, oí course, all the ne wi 
а category would share а common die simpl 
the stem. In such cases, the procedure шыта, 
to modify the code number and engan correct 
from the next category. The locations | rnatives P 
alternative and the various distractor a z numbers: 
the item were also determined by randon (or a 

In this way, а 72.item кш itid 
least. writable) synonyms test with four ЕЕ pave 
items was developed. Such items and iens items 
several interesting properties, First of all, su specified 
are definitely a random sample om а of them 
Population of items, Thus, a test composed tion ^ 
would conform rigorously to an АШ: while 
several ways of estimating reliability. Secon ЫШ 
the population of items is very large, it is native 
finite. Similarly, semb! 
test forms of a given length that can be ie nite: 
from such items is very, very large, it нет те 
It appears, moreover, that the finite M CR 0 a 
Primarily from the complete am omm 
Operations for writing items and may Since t 
to many, if not most, item [ШШШ this K 
population of items and tests is very we theoreti 
few practical implications. It may у. scores л 
implications, however, For example, tru number 
usually defined in terms of an infinite 
tests. cedures “ 
Moreover, it appears that similar pro’ ptitude x 
be used to Write many other kinds of ар pro Ci 
items. With only minor modifications m to a” 
used in the present study could be P may + 
analogies items, The results of this э “мй, 
generalizable, therefore, to some tests irmount? a 
mental processes. In addition, no ora ite, 
difficulties should be encountered in pt попе m 
computer to write mathematics items, p: proble ер 
veloping efficient distractors might be jmisin£ E 
The work of Osburn (1966) is a pro 
toward computer-written math items. 


; TEST | 
EVALUATION or THE TES ith 


if б; 
The computer-written test, веће erie 
the WRVT, was administered sil in ш 
freshmen at the University of To orsi 
fall of 1965. A generous time limit I tes ^. 
all students to complete the computer p” 
the end of the first semester, the gr? 


R sible types al 
! Tt is less clear that all possible папе "n 
сап be written by computers. John а 


ted qan 
1 Bi Жүк jdisl g 
sonal communic: tion, 1964) has pena equi gtin 
for items in which alternatives are poi es 


Ы kely tha 
In а response space. It is most unlikely 
Computers can Write such items. 


Саҳ Computers WRITE Tests? 


TABLE 2 


COMPARISON or Two PARTS Й 
sox or Two Parts or Wipe RANGE Test wrrü Tests 


COMPOSED oF SELECTED COMPUTER-WRITTEN IT] 


2 1 
Malesa ma 1 2 | 3 Р s 
Wide Range Test | 
2 Рай 1 | | 
s Part 2 "E 
9mputer Test 51 = | 
+ Iten 
d pe кше for validity 62 A3 = | | 
y Items severed fot hpmogndte 61 Im 93 & d 
‘oni атша 4 A5 80 88 
Orrelation with’; 56 7 D == 
AN DIU e .56 71 | .61 4 3 
Se ната 29 21 al n d 
Sp 24 24 24 24 a” 
Females 12.32 11.54 | 1863 19.03 14.94 
Mum 3.39 434 347 3.08 3.78 
к Капде Test 
art 1 : | 
o Part 2 - | 
Mputer "est 50 = 
* Items sel 
4, téms ые for validity 52 56 | — 
Kh tems d for homogeneity AS 56 | 92 | — 
C ч relial tected for discrimination 51 „58 89 | 88 — 
A lation wie. 68 uas 5| 5 6l 
ap tems ith first-semester GPA 28 2m | 30 29 29 
Sp 24 2 24 M 24 
13.57 11.58 19.30 19.66 | 1646 
| 4.14 3.14 29 | 269 | 35 
| Misco 


Ae e 


tiong Yote, 
a AOI 


Ке Was 

Rich lans determined for these students.” 

"aliq 5оп wee deviations, Kuder- 
Чез, oe 21) reliabilities, predictive 

Ate got 599 ae of the two 

ies in aes 613 female freshmen 

S results ` 


i partly 
е items į ра 


test, 
the 


› аг аа 
Uter the reliabilities are 10 
еа" This is disappointing be- 

er length of the computer test 


du ч 
Се higher reliability. On the other 
Je to those 
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Oh ‚ and the intercorrelation of 
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it Meg ашо, 
sí, Would like to thank Ted McCarrel, 


ansible pler, ; T 
the Dat, © for y; 2nd Willard L. Boyd for making 


а a in | 
a anapa fo obtain these data. 


"Sis x ^ й 
of d this study was carrie 
Маһ computer center. 


d out at 


ise item selection and correlations аг 


е based on the same group. Intercorrela- 


not too far from the limits 
. On the whole, these results 
enough to justify further 


the two tests is 
set by reliability 
are encouraging 


analysis. 
Since the items in the WRVT were carefully 


selected, while the computer test consisted of 
entirely unselected items, the effect oi item 
selection should be evaluated? The WRVT 
consists of two parts with 24 items each. 
Accordingly, 24-item tests were selected from 
the computer test by three different pro- 
cedures. The item selection was based only 
on data for males, so that the female sample 
would provide a cross-validation group. The 
first procedure, designed to maximize validity, 
to pick the 24 items with the 


was simply 
highest correlation with first-semester grades. 

ате should be noted, however, that selected items 
are no longer a random sample from the specified 
population. 
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'Тһе second procedure, designed to maximize 
homogeneity, was to pick the 24 items with 
the highest correlation with the computer test 
total. The third procedure, designed for high 
discrimination among students tested, was to 
eliminate items answered correctly by more 
than 90% or fewer than 10% and then choose 
the 24 items with the highest correlation with 
the computer test total. Each of the pro- 
cedures, of course, could easily be incorpo- 
rated in a computer program for assembling 
test forms. 

Data for the two parts of the WRVT and 
the three different tests composed of selected 
items from the computer-written test are 
summarized in Table 2. It should be remem- 
bered that some values for males are inflated 
because the correlations and item selection are 
based on the same group. There is also con- 
siderable item overlap in the three computer 
tests, which produces much inflated. inter- 
correlations, 

While the Computer test is still somewhat 
easier, these data confirm without qualifica- 
tion that Synonyms tests can be successfully 
written on computers, Each of the three com- 
puter-written tests correlates about as highly 
With the two Parts of the WRVT as the two 
Parts correlate with each other; the reliability 
of each computer test is somewhere between 
the reliabilities of the two parts of the 
WRVT; and the Predictive validities of the 
computer tests are, if anything, slightly higher 
than the validities of the WRVT, 


Discussion 


| The results clearly indicate that it is pos- 
Sible, in Principle, for com 
some kinds of colle 


existing computer tec, 
entirely feasible, in 
many, if not all, 
sions testing. It w 
in each high school an input device to a 
central computer 
device, the computer would display test items 


back to the computer. Through “time shar- 
ing," many students could be tested at once. 
, 
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The central computer would generate Е. 
items, include а few with each test ee, 
istered, develop and equate alternate fo Е 
of the test, score each student's test, on 
even transmit the scores directly to ae, 
computer (or output device) at the Ye 
the student's choice. Thus it would pr 
possible to eliminate answer sheets, bi por 
machines, and score report forms (t e M 
sibilities for computer display of ox 
Sponse recording, etc., exist, of we 
as fully for tests prepared by people p chis 
do for computer-prepared tests). All 4 þu- 
could take place entirely “untouched че 
man hands." It seems probable, more e 
that in the long run it would be to e gn 
nomic advantage of test agencies to riting 
mate their operations, including item ы con" 
While this is possible with Lace inr 
puter technology, a possibility is a objet” 
perative, and there are many legitima is 
tions to such a dehumanized Syster thers 
hoped, however, that humanists maake a 
appalled by the 1984 overtones will ? mplied 
more serious response to it than an pute" 
Luddite computer smashing. For if £o obje” 
written college admissions tests et other 
tionable, rejection of them on some w^ ў 
than predictive validity, while ee valid- 
changed the social system making wen nest 
ity possible, would be a particularly mil 
and deplorable case of removing diseas*. 
rather than treating the underlying issues 1T 
Any serious confrontation of the 1 evi" 
volved must recognize what is, ОП y И 
dence, an indisputable fact: пайы ру 
multiple-choice tests—even those Ope ntl) 
computers—are the best and fairest ae етіс 
available estimates of potential for к uted 
Success in colleges as they are now pi colle 
This is true in the sense that an a 3 7 Я 
applicant, if he is behaving rationa rie yi 
own self-interest, will take such a tes cade 
erence to other ways of having his EE 550) 
potential evaluated, such as taking 4 : 
examination or being interviewed. вой ү 
What convincing argument, then, write 
advanced against having such ten im 
by a computer if the products е" : 
distinguishable from, or superior inks g 
written by people? The author ie rath? 
serious criticism of such tests mus 


ing 
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CAN COMPUTERS WRITE TESTS? 21 


begin wi 
к a criticism of conventional meas- 
of grades gi in college, or, to put it bluntly, 
gtades can E by college professors. If 
completely | predicted reasonably well by a 
Wrong with Калаа аай test, just what is 
ted be шы That something may in- 
тапу ы wrong is indicated by the 
relationship b showing, at best, a negligible 
Outside the » tween grades and performance 
uman Eoi assroom in important areas of 
ollanq. & го (Hoyt, 1966; Richards, 
; X Lutz, 1966). 


REFERENCES 
P. College grades and adult accomplish- 


revi > t 
Pa of research. Educational Record, 


Hon, р 
Tent: | 
1966, 47 


1 


Оѕвовх, H. С. Computer aided item sampling for 
achievement testing. Paper read at American Psy- 
chological Association, New York, September 1966. 

Pace, E. B. Automatic grading of student essays. In 
E. B. Page (Chm.), Automatic processing of nat- 
ural language: New methodologies for educational 
research. Symposium presented at American Educa- 


tional Research Association, Chicago, February 


1966. 

Ricuarps, J. М. Jx., HOLLAND, J. L., & Lurtz, S. W. 
The prediction of student acomplishment in college. 
Iowa City, Iowa: American College Testing Pro- 


gram, 1966. 
Rock, D. Assembly 

item file. Research 

N. J: Educational Testin 


of tests by use oí an automated 
Memorandum 65-14. Princeton, 
g Service, 1965. 


(Early publication received November 14, 1966) 


of Applied Psy 


51, No. 3, 


316.332 


LEVEL OF PROFICIENCY AND MULTIDIMENSIONAL 
VIEWPOINTS ABOUT PROBLEM SIMILARITY’ 
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The object oí this research was to determine whether individual consistencies 
in judgments of problem similarity are related to the proficiency level of the 
judges. 51 radar controllers of varying levels of experience and competency were 
asked to judge the degree of similarity among 30 air-traffic control stimuli using 


the method of successive intervals. These data were analy: 
“points-of-view” procedures developed by Tucker and Messic 


d according to the 
‚ 4 dimensions of 


viewpoint were extracted representing 4 major subgroups of Ss, each of which 
exhibited consistently different emphases in their judgment of stimulus simi- 
larity. Results indicated that (a) assignment to a viewpoint group was related 
to training and competency level, and (b) Ss with greater proficiency tended to 
view the stimuli, not in terms of their physical characteristics, but rather in 
terms of the responses that would be required for air-traffic control. 


Several studies have indicated that not all 
Ss use the same perceptual dimensions when 
making similarity judgments of visual stimuli. 
For example, Helm and Tucker (1962) 
found that judgments of color similarity for 
color-blind Ss produced a multidimensional 
space quite different from that of normals. 
Tucker and Messick (1963) have developed 
analytic procedures for determining the num- 
ber of different viewpoints about stimulus 
similarity represented in a set of individual 
judgments and for identifying Ss who “рег- 
ceive" the stimuli in a similar fashion. In a 
recent application of this technique, Silver, 
Landis, and Messick (1966) uncovered several 
dimensions of viewpoint in judgments of 
similarity among random geometric forms. 
Silver, Landis, and Jones (1965) also demon- 
strated the same phenomenon of consistent 


1 This research was supported by the United States 
Naval Training Device Center, Port Washington, 
New York, under contract N61339-1345, Gene 
Micheli, Contract Monitor. The authors wish to ex- 
press their appreciation to David В. Saunders for 
supervising the computer analyses and John Wilson, 
Chief, Training Section of the FAA Oberlin Air 
Traffic Control Center for help in securing Ss. Por- 
tions of this research were presented to the joint 
meeting of the Psychonomic Society and the Psy- 
chometric Society, Niagara Falls, Ontario, October 
1964. 
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individual differences using visual d P'he 


resembling political situation maps- to 


gather independent information on t int 
acteristics of Ss exhibiting each "po! {50 
view.” However, Landis, Silver, and Нап ie 
(1966) subsequently demonstrated that ri 
viewpoints correlated with cognitive ре ned 
tual style. The present research was des у be 
to gather information of the relationship ple: 
tween these viewpoints and a training V? 


METHOD 

Subjects riment 

A total of 51 Ss participated in this сүр, айо 
all of whom were employees of the Ёейега ’ perl 
Agency (FAA) Air Traffic Control берт, iur 
Ohio. These 51 FAA employees represen © |Р 
classifications: assistant controller, manual € А thre 
radar controller, and coordinator. The a er. 
groups were further subdivided into levels qain 
petency according to the judgment of the 
department of the FAA Center. 

Sixteen Ss were classified ‘ i 
six were rated “excellent,” nine “goody, та 
“poor.” These 16 Ss had minimal expe?” ne 
interpreting radar displays. The duty © adv? 
sistant controller is to provide the тоге ы 
controllers with flight-data strips on the лс 
inbound, and over-flving aircraft that con 
the jurisdiction of their sector control. 

The seven members of the second grat a p f 
tained the rating of “manual controller 2 «poe 
rated “excellent,” three “good,” and two 


er" 
roll e 
TT cont^ оп 
istant © and 4h 

wi 
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The duty 
ances to de manual controller is to give clear- 
Чай as they fi тий, inbound, and over-flying air- 
Sector; he f ollow flight plans within the controller's 
чо. requently uses the radar scope in his 
2 Wenty- ‹ 
Sa ERU D UAE controllers" constituted the 
ie “good.” Ss; eleven were judged “excellent,” 
p the eM three “poor.” The radar controller 
nip ctor. He “Жез чш for all aircraft in 
› issue rane communicate orally with the 
Ф * certain th es, and observe the radar scope 
arated, Nat ES all aircraft in his sector are 
aturally, this group and the one below 
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е fourth ; 
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Ors, ү 
re aw? Who are res А 
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according to ntrol process. This group was not 
J competency. 
Stinni; 5 


itty a 
тай Y аїг-{га{ 
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lative lems, Th of the FAA from a larger set of 
е problems selected were represen- 
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tion’ Within ie à variety of such problems as pos- 


n 

i, с strai : ? 
Was рте нй imposed by the simula- 
Meng 200 by twe € adequacy of the representation 
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the eon with Oberlin Trafic Control Center, in 
air-traffic controllers familiar with 
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Te » and air р 
Presented ipai identifications) for all : 
s 4 the traffic situation. Figure 1 isa 
dis ue the map and flight-data 
st 5 possible pairs of traffic-control 
Structed, a cae М 

or ‚ and each pair was place 
"e Presentation to Ss. | 
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E S piv 
l of ыл a stack of 30 cards, each cone 
Sire Selo, the 30 stimuli, Each was instructed 
mij, "ect Stack, | h : 
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roced situations he judged 40 be leas" 
б ОГ ү, Чїй of requiring each 5 to judge 
ds las T М used to ensure some de- 
У wit " li 
exper the total range of stimu 
fs Ме tly iment proper 
У, сас 3 
rd р E 41 S was presented with the set 
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16 aa” to continue to subdivide unti 
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Fic. 1. Sample stimulus. 


least. similar pairs. The S was given 
to reexamine the stacks and was en- 
couraged to make апу adjustments in stimulus 
placement that appeared necessary. Depending upon 
which of the 16 categories of judged similarity а 
stimulus pair had been placed in, а score of 1-16 was 
assigned to each pair for each S. 


pairs to the 
ample time 


RESULTS 
The similarity scores were analyzed using 
the Tucker and Messick (1963) individual 
differences model of multidimensional scaling. 


This analysis first determines the number of 


different “points of view” about stimulus 
similarity (as reflected in consistent individual 
differences 1 


in the ratings) and then provides а 
separate multidimension 


al representation of 
the perceived stimulus variations а 


ccording to 
each viewpoint. Scores representing the extent 
a individual's rat 


to which each ings correspond 
to each viewpoint are also provided. 


Dimensions of Viewpoint 

The individual ratings of inte 
геге tabulated into a matrix with one 
h S and one row for each pair 
the matrix was of order 435 
x 51). A 51 x 51 matrix of sums of cr 
products among these similarity ratings W 
then factored to determine the number of 
dimensions of “yjewpoint™ among the Ss. The 
ern of characteristic roots from this analy- 
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Fic. 2. Components of subject space (viewpoints 
dimensions) . 


sis (presented in Figure 2) indicates that at 
least four dimensions or points of view can be 
distinguished among the Ss. The four factors 
corresponding to the four largest latent roots 
were rotated using the Equamax approxima- 
tion to simple structure (Saunders, 1962). A 
factor loading was thus obtained for each $ 
on each rotated factor or viewpoint dimension 
(in this case the factor matrix was of order 
51 X 4). The size of these factor loadings in- 
dicates the extent to which each S's ratings 
corresponded to the particular viewpoint. 

Tn order to see if these points of view about 
stimulus similarity were in any way related to 
individual levels of training and competence, 
Ss were classified into four subgroups rep- 
resenting the major viewpoint dimensions; 
this classification was then compared with the 
classification based upon training and com- 
petence. The rationale for the subgroups was 
as follows: Each S receives a factor loading 
on each of the four viewpoint dimensions, 
According to the individual differences model 
of multidimensional scaling, the size of these 
loadings indicates the weight each dimension 
receives in reproducing S's individual simi- 
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larity ratings by a linear combination inf the 
four factors. The dimension on which an | 
receives his highest loading thus represen 

the dominant influence in his own individ 
view of the stimulus characteristics. For 
present purposes, Ss were classified in 4 P 
ticular viewpoint group if they had the ym 
dominant dimension (ie. if they ew. 
their highest loading on the same vieWP "i 
factor). There were thus four subgroups jen- 
corresponding to each of the viewpoint ш. 
sions. However, even though the dimens ue 
had been rotated in this study to capita” 
upon whatever simple structure ocer 
the sample, most Ss tended to be ЧАН ШЕ 
throughout the four-dimensional space; o 

moderately high loadings on more ec А 
dimension. It was recognized that the С vould 
cation of such Ss by the present rule spoilt 
tend to dilute the homogeneity of ҮТ the 
within each group, but it was hoped rmit 4 
simplicity of the assignment would P view 
quick appraisal of the relation [ye адм be 
point and competence that could aw 
elaborated by more refined categorizat! e 

The relation of training and qu 
levels to viewpoint placement was ente т 
Viewpoint Group C clearly represe this 
skilled group; 11 of the 13 Ss assigne md 
group had been classified either T: is P 
troller” or “cooordinator.” Further, * { 
teresting to note that of the 2 5s pe A 
seem to belong in Viewpoint C s п 
their low experience classification, 1 E A 
sidered by his superiors to be an € th 
capable controller who would move 
ranks quickly. 

Similarly, Viewpoint Group А 566! 
made up primarily of unskilled gum 
of the 16 Ss assigned to this viewP point 
at the assistant-controller level. Vie e o 
and D were not as clearly drawn 25 ^, jr “| 
two, but there were attributes of per. 
Sociated stimulus spaces (discus P s 
that appear to differentiate them, W pet Ie 
pearing to represent a somewhat hig 
of competence than B. 
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For each viewpoint, interstimulus pe E 
were then estimated by averagins view? 
larity ratings for all Ss in that 
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(1963) ie language of the Tucker-Messick 
tained for and distance estimates were ob- 
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Matrices cae The four resulting distance 
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Ee iem scaling procedures (Messick 
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Viewpoint, RM variation according to each 
our multidi е characteristic roots from these 
wrtrayed DS alge scaling analyses are 
Ae indicates ae 3. The pattern of these 
ding to Vie that stimulus similarity ac- 
imension Wpoint Group A involves sev- 
* large ie stimulus variation—at least 
‘ight altoge т ааны perhaps as many 
iis m же, er. Viewpoint Group B, on 
us ү буо ipe ge Жы emphasize only 
Sizeq Imension aa te un cupere in 
nd perhaps three moderate- 
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ley Con rol Skilled FAA personnel (Air 
Mes е Bue рен) were asked to 
ine B wa stimuli and to suggest 
he Were th ious dimensions. The names 
tg d а set he used as a basis for de- 
Mulus c ypotheses about the under- 
ig o htnua. Six hypotheses Were 
manner: 
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Шу of problem, 

es У for action. 
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ing each stimulus according to the following 
considerations: 

«Watching" (in Hypothesis 
as the degree of continuous m 


radar scope requir 


1) was defined 
onitoring of the 
ed to ensure that two Or 


more aircraft on possibly conflicting courses 
will pass with the required separation. Some- 
time aircraft are not on conflicting courses, 
but their present separation is marginal and 

ircumstances (such as pilot 


any unforeseen ci 
lapse, weather, ОГ technical communication 


difficulties) could produce а conflict situation. 

«Amount of analysis” (Hypothesis 4) was 
derived from the number of computations 
necessary to determine that an adequate 
separation is being maintained for all aircraft 


in the sector. 
(Hypothesis 5) refers to the 


“Severity” 
complexity of a given situation. It is a com- 
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TABLE 1 
RANK CORRELATIONS BETWEEN STIMULUS Loapincs on Eacn DIMENSION 
n AND STIMULUS VALUES ACCORDING TO Six HYPOTHESES 
ў Correlational value 
T | m iam Т 
zs =e | | iewpoint D 
T Viewpoint | Viewpoint В | Viewpoint C Viewp' 
Hypothesis | ki _ , 
| ШИГ D- 
| D6 | Di | D2 | pa | p2 D-3 D-1 ——^ 
| | | — ——— =й 
| * 2 
"atching 08 | 37 | sse | ase | ae | = 
baee | 21 | 03 —03 | | 18 01 “19 
a — 38* | 2 729+ | 3 E 16 
ecti . | = 5 55 
unb of analysis 08 | A0* ШЕ | .53* Ses "e 
Severity С =14 35* 65*** | 35 1; LA 
у : | sae p see E 
Action | ni | | 53 55 5 Бк эе. 
Note.—Abbreviated: D = Dimension. 
жр < .05. 
ж < .01. 
*** b 2001. a 
m. 
imensio 
А Р ral dime? a, 
posite of the amount of watching, analysis, that would be related to the peter {тот п 
and action. Situations that involve a great of Viewpoint A may have гези! hypo f 
deal of action are considered Severe. If two — particular manner in which C t 
situations require immediate action and one were constructed. It will be кч уеге s, 
also requires considerable analysis, the latter names for the various dimensioni and it v 
is judged more severe. ited from radar-training personnel, ап”, jdu 
“Action” (Hypothesis 6) refers to the im- 


mediacy of controller action required in a 
given situation. Stimuli are ranked high if 
action is required upon an immediate inspec- 
tion of the figure (for example, when two air- 
craft at identical altitudes are converging at 
the rate of 1,000 knots air speed) and inter- 
mediate if action is determined only after 
some degree of analysis. 

Because of the complex nature of Hy- 
potheses 4, 5, and 6, it was not possible to 
derive objective indexing rules, Instead, 
stimuli were subjectively ranked for each hy- 
pothesis by independent judges using all the 
information contained in the protocols; inter- 
rater reliability was greater than +.90. 

The stimulus ranks based on each of the 
six hypotheses were then correlated with the 
stimulus ranks given by the factor loadings 
on each dimension. These correlations (for 
those dimensions yielding significant values) 
are presented in Table 1, For Viewpoint A, 
there were no significant correlations for five 
of the dimensions, and only one significant 
correlation on Dimension 6 (with Hypothesis 
3). The failure to develop any hypotheses 


vidu“ 
" 


p : indi 
be that these highly experienced i ensi 


Were not sensitive to the kinds of me 
typically used by less experience е 
would probably have been a better j 1 
to have the less proficient Ss attemP T 
the dimensions as well. жү x 
Upon examination, the dimension” ities jes 
point A appeared to reflect sim йа 
stimulus characteristics rather tharis ie P 
in the kinds of responses qu 5 
situation (as embodied in Hyg im 
and 6). The stimulus situations Tevel- Уо 
sion 1 range from those involving wi 
aircraft heading in one direction йер! 
convergences or conflicts, to id no? 
one aircraft descending to land wit jmen? 
aircraft in the area, The stimuli 9 yhic? 
2 range from those situations in Y altit" 
ag * ich 90 
with 
convergences and no conflicts. 
mension reflects the degree to whic a 
depict weather problems. The ра 
fourth dimension appears to be ^d a 
conflict, but this dimension is sma 
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at the other ex ude of preceding aircraft, and 
Same altitud extreme are two aircraft at the 
tate, ude closing head-on at a very fast 
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Skilled it seems Mes ki response require- 
TN tadar cont cng conclude that 
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Vie Stimulus ES characteristics per 86. 
imp Point C Ж Ge on Dimension 1 of 
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"equi, Decause ( i arly to avert any possible 
© not only i weather), to those that 
sis ang 7 camini watching but much 
Жы considerable action. 
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b: lysis a ional flight, no convergences. 
апа a fair amount of watching. 
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Doing Te Wagen ADU, contain dimensions 
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P te epi Berd С. One dimension In 
А fou B and D (B-2, D-1) is simi- 
aoe Iya ene in Viewpoint C, in that it 
LAUD icantly with the four hypoth- 
s Чоп wa response requirements- This 
ets id nad thus represent the response 
an da eet of similarity judg- 
sy they lewpoint Wo groups. In addition, how- 
base Win e B am D both contain 
б Чеш “Чат that is not related to ге- 
iy ip" Y dn Y this other теры. 
"ity tees Prima oe B, appear ms 
nsi able T y by stimulus character- 

n in yi ). Since the response-related 
iewpoint D is larger and ac- 


counts for more of the interpoint dista 
variance than its counterpart in Viewpoint В, 
it would seem that the individuals in Vie Es 
point Group D tend to judge problem strut 
larity more in terms of response requireme ^s 
than do individuals in Viewpoint Grou B. 
Furthermore, since response-related dimen. 
sions are characteristic of the skilled approach, 
of the most proficient group (Viewpoint C) 
it would appear that Viewpoint Group D тоге 
closely approximates this skilled approach 
than does Viewpoint Group B and that they 
might thereby be considered to have attained 
a more advanced level of proficiency than that 


achieved by Group B. 


DISCUSSION 
{ this investigation indicate 
that radar controllers exhibit consistent in- 
dividual differences in their viewpoints about 
the similarity of air-traffic control problems 
and that these viewpoints are related to in- 
dividual levels of training and competence. 
The judgments of the least skilled group 
(Viewpoint A) appeared to be based upon 
many simple dimensions depicting various 
stimulus characteristics, whereas the judg- 
ments of the most skilled group (Viewpoint 
С) appeared to be based upon à small num- 
ber of complex dimensions reflecting the re- 
sponse requirements of the stimulus situations. 
Viewpoint groups of intermediate proficiency 
appeared to utilize one complex dimension of 
response requirements and one simpler di- 
mension of stimulus characteristics. The over- 
all pattern of this relation between proficiency 
level and judgmental consistencies suggests 
that different approaches to the training of 
radar controllers might be profitably in- 
vestigated—in particular, one in which train- 
ing is initiated by considering from the outset 
the various relational configurations that oc- 
cur in traffic-control situations along with 
their attendant response requirements, rather 


than by first considering simple, clear-cut dis- 
pla and their associated stimulus charac- 


teristics. 

Landis et al. (1966) have demonstrated a 
relationship between points of view and cogni- 
tive-perceptual style using measures that pre- 
are not variable over time (Gardner, 


The results 0 


sumably 
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Holzman, Klein, Linton, & Spence, 1959). A 
longitudinal study investigating the relation- 
ship between cognitive-perceptual style and 
proficiency level might very well indicate 
whether or not proficient controllers do, in 
fact, change their ways of perceiving or do 
they become proficient because they come 
into the program with certain styles of per- 
ceiving and thinking. Such a study would have 
important implications for training programs. 
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interrelationships of an index of ассїйеп 
b tenure, 
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w А T 
A simple with accident rate, age, JO 


ers was studi 
was studied. The following results we 
significantly related to 


accident rate wa 


Fe Seek блр 
of 62 industrial employees includi 


t proneness (AP) obtained from 
and job hazard were investigated. 
ng unskilled and professional work- 
re obtained: a higher than average 
high job hazard (phi = +.31) and 
age job tenure was significantly 


hig! в 
NAE (phi +28). A longer than aver 
та А Ee jy accident rate (phi = —.38) and current. placement in less 
AD spares jd сав — — 27). Ss having long tenure also had significantly lower 
je s (phi — —.29), and older Ss also tended to have lower AP scores. 
‚ this 
tig, , 1ероге i 
n = is fif à — " ; 
th in a series of investiga- 4, Judgments of “accident prone behavior” 
of 116 psychiatric patients. 


Kune 
Wort nate ps 1966; Kunce, Stur- 
ey, 1966 i & Castor, 1966, Kunce & 
Psychologie a studying the relationship 
m S ОСО: factors in accidents. The 
Zed in ari Interest Blank (SVIB) was 
а person? study to test the hypothesis 
ests) is hs of life (reflected in his 
мы to incurrence of accidents. 
RSS has demonstrated that 
Patterns, th es relatively enduring in- 
al for У сше showing considerable 
Could Ъ ding an index of life style 
Nt-engen я evaluated with respect to 
ессе 25 behavior. Two scales 
та uresome selected to give indexes of 
Usnegg? ness" (Aviator scale) and 
t pron (Banker scale). An index of 
TE the tr (AP) obtained by sub- 
land er standard score from the 
score was found to be sig- 
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E ata 
iy," th related to: 
a, Сите А 
t nc eT: 
2, хор of i of severe physical disabilities 
ttio Choo] re adult male patients. 
‘Sting for Pare of accidents ov 
: high school students rio 10 


ег a 3-yT- 
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a student health clinic for 


Irie: 
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ог pret not for illness) over 2 ^" 
hp. university students follow- 


Jt 
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Tes 
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H 


ach of these studies, Ss having AP scores 
had approximately twice the 
dents than Ss having lower 


Ine 
of 11 or more 


number of acci 
scores. 

The present study W 
test the validity of AP 


accident proneness for 
dustrial workers. In addition, this type of 


population enabled us to investigate the in- 
teraction of AP scores with other relevant 
variables such as employment stability and 


job hazard. 


as designed to further 
scores as a measure of 
a population of in- 


METHOD 

оуееѕ of Birds 
a division © General 
Washington state. 
asked whether 
in а research 
of the regular 


Subjects. The Ss were 62 male empl 


Eye Manufacturing Plant, 
Foods Corporation, located in 
A wide variety of employees were 
they would voluntarily participate 
project. Those tested were members 
work force covering à broad range of occupations 
including supervisory pe engineers, account- 
ants, electricians, production work- 
ranged from with a mean 

ged from 3 

The SVIB was given to each 5 and 
t proneness (AP) was obtained as 
d by ing the standard 
{ the Aviator 

{ the previous studies, 

e considered “high,” 
and less than —10, 


from that О 


scale. 
АР scores gre 
+10 through 
“low.” 

An index of acciden 
dividing the total num 
the industrial nurse by 
worked. The rates 50 obta 
8.00 per Year with an average of 1.81. 


ater th 
=j "averages" 
or was determined by 
ber of visits for accidents to 
the total number of years 
ined ranged from 0.00 to 


t behavi 
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TABLE 1 


INTERRELATIONSH IP OF ACCIDENTS " 


: 5 
АСЕ, YEARS EMPLOYED, Jon HAZARD, AND AP Score 


2 3 4 5 SD 
M 
Variable | Years Job AP 
| Age employed hazards scores 
| E 1.98 
І. Accident rate | —.02 —.38** +.31* +.28* | 1.81 11.01 
f 2 E | --.08 +418 — 22 41.45 5.53 
2. Ag c. 8 M | o 2 
3. Years employed m —.29 à 0 134 
4. Job hazard vest me 15.50 
5. AP scores .02 
T < .05. 
** 5 € 01. 
ying 
" М Ss hav 
Estimates of job hazard for each job were made ardous jobs (phi 2 —.27). The jos 
by the plant safety officer using a 6-point scale of long tenure also had significantly ten ed 
1 (minimal) to 6 (maximal). The distribution of Ss scores (phi = —.29), and older Ss also 
in Categories 1 through 6 were 4 3, X7, Th 30. 075 > i 


and 3. Examples of job types in cach category, 
respectively, were accountant, stock clerk, production 
supervisor, lift truck operator, maintenance mechanic, 
and viner mechanic, 

Procedure, The interrelationships of AP scores, 
accident rate, job hazard, age, and years of employ- 
ment were evaluated by computing phi coefficients. 
This method Was used in preference to product- 
moment correlation, since the data, particularly AP 
Scores and accident rates, were not distributed nor- 


necessary computations, the 
age, accident-rate, and duration-of-employment vari- 
ables were dichotomized at the mean. The job- 
hazard variable was dichotomized into nonhazardous 
(ratings of 1, 2, or 3) and hazardous (4, 5, or 6). 
AP scores were dichotomized as "normal" (10 or 
less) and “high” (11 or higher), 


RESULTS 


A higher than average accident ra 
nificantly related to 
+.31) and high 

longer than av 
nificantly related 
= —.38) and сиг 


te was sig- 
high job hazard (phi — 
AP scores (phi — +.28). 
erage job tenure Was sig- 
to a low accident rate (phi 
Tent placement in less haz- 
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to have lower АР scores. (See Table 1) 
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trate the personal factor in ca 
into consideration the interaction of V ith 
ard with AP scores and job tenure W à; 
scores. iden" 
In the hazardous jobs, 647% of the aident 
prone Ss had a higher than average 2 cident 
rate in contrast to 397; of the 1ез5-4© nt 


haz 
AP 


ce! 
4 ч jobs the ре! а! 

prone Ss. In nonhazardous jobs sim! 
ages were 36 and 0, respectively. ё inte 


pattern is obtained with respect to ia and 
action of job tenure with AP sco" я 
accident rate, for em 
Further investigation of the е, ча moe 
Ployees carrying out jobs rated 6, 


Fu е 
А ? р 
having an Ар Score greater than —_ Ü 
more, this employee was the only 
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Job hazard 
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The contributions of projective techniques to 
and the relationships of projective variables 


presented. The projective data wi 
clinical psychologist from 3 ргоје 


assessment-center staff evaluations 
to progress in management are 


ere obtained by coding reports written by а 
ctive instruments. Analyses of the data show 


that the projective reports particularly influenced the assessment staff in rating 


such characteristics as wi 
several of the projectiv 
ment, especially those pertaining to 
brief, the findings clearly indicate 
motivation was obtained from the pr 


e variables 


Ап assessment center for the measurement 
of potential for business management has 
recently been described and analyzed (Bray 
& Grant, 1966). Among the analyses presented 
are the contributions of the various assess- 
ment techniques to staff judgments and the 
relationship of each assessment technique, 
as well as the staff judgments, to а salary 
criterion. The assessment center studied is 
part of the Bell System Management Progress 
Study (Bray, 1964), a longitudinal investiga- 
tion of the development of young men in a 
business management environment. 

Two of the assessment techniques used 
Were not included in the previous analysis, 
that is, the interview and the projective tech- 
niques. This article presents findings on the 
Projectives; a similar study of the interview 
is in process and will be reported later, 

Although projective techniques have been 
rather widely applied to the evaluation of 
managers, their usefulness has not been con- 
vincingly demonstrated ( Kinslinger, 1966). 
Neither has their contribution to the judg- 
ments of assessment-center staffs been ana. 
Ivzed even though projectives have been used 
in most of the major trials of the assessment 
process. Where data have been reported they 
have focused on the relationships of evalua- 
tions based on the projective techniques: to 
criterion performance (Hague, Otis, & Prien, 
1062: Huse, 1962; Kelly & Fiske, 1951; 


2 


ork motivation, passivity, and dependency. In addition, 
are reliably related to progress in manage- 
leadership and achievement motivation. In 
that relevant information on managerial 
ojective reports. 


ted 
repo 

MacKinnon, 1958). In general, te quent 
correlations have been low and, М 
not reliably greater than zero. th 


Practically no information, owes g to 
contributions of the projective шш pee” 
the evaluations of the assessor ha jd 
reported. The omission apparent? he 107 
flected a general lack of concern pun 5655 
Separate techniques play in the to р 
ment process, ау data bi 

The Management Progress Wm contri 
ford an opportunity to examine T n 
tion of certain projective methoc A 
ment-center judgments, which in m 
shown to be predictive of progres? е ‘ 
ment, and the relationships of pro) ^ 
ables directly to a progress o ap 
the projective data nor any other 
information have been available p 
tem management or the subjects pne 
is, in other words, no contamina 
progress criterion. 


a 


55° 
ee” 
ge 
an 


of 


Projective TESTS 


Three projective techniques ha t 
ployed in the assessment centers t 
agement Progress Study. These ar k. 
Rotter Incomplete Sentences Blan Test: jo" 
Management Incomplete Sentences perc? T 
(3) six cards from the Thematic AP Ld 


EA a Ka 
Jalter 

1 This test was constructed by Ne rar 

Vaughn C. Crandall, and Julian B- 


26 


ve bee! 
he 


tke 


As; 
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Test ( 
Car 
6). The E 6BM, 7BM, 8BM, 14, and 
est was kie чы Incomplete Sentences 
and consists yop specifically for the study 
Pa selected Es items, The sentence stems 
range of meets assist in assessing a wide 
wtitudes an es pertaining to management 
ent ae ну such as achieve- 
Olvement er level of aspiration, job in- 
и а 
al cis toward different types 
Регіогѕ, рее 5, and effective reactions to 
4 The TAT rs, and subordinates | 
W. ng >: 
ym баве г administered in small groups 
is each pictu six Ss; each S was presented 
fol ested to "- individually. The Ss were 
lolloyi wr В E 
i owing three ite their stories using the 
Prej Pening in questions as a guide: What 
san Duy MI picture? What occurred 
ha "4 You see — about the circum- 
outs ^ in the futur the picture? What will 
ire; how will the story turn 


he 
SMa Projectiy 
ate Stoups E tests were administered in 
Con Ss ad r y in the assessment program 
the ing the eceived a general orientation 
оц пре и a of the program and 
by a the . Th y of the information obtained 
Dort clinica] e protocols then were evaluated 
form n the 5 Sychologist who wrote one re- 
al hated ‘oo and hypotheses he 
Bist, Tee frei each individual based on 
bins as Two clinical psycholo- 
3 genera] the 355 reports. Each pre- 
“hich” t Fiir ca, sei of the S's person- 
Pies given to characteristics 
ence his management career, 


3 : 

Б his gene 

ее attitudes ar level of adjustment and 
tudes and feelings about his job, 


Noy” family 
"lly, and self. The intent was to 


Dor. а 

"ts id 

Cae 8h ео К 

me to er i. approach in these T. 
P n attempt to fit the individual 


or Sta Prescy} : 
cy ons Dinge list of variables. As the 
tq ;, Stency ey however, a large degree 
маа occur in the dimensions 
8n c ble vari reports, although there was 
m D y oe in the elaboration 

Nie "ojective personality dimension. 
w a re test report on a given S, to- 
MN Droxi Ports written by other sta f 
in appa tely 
T by ed 


ve reports 


80% of the projecti 
the re- 


by үү; 
Озер} alter Katkovsky and 
Seph Rychlak. atkovsky an 


members based on different assessment 
niques, was read to the assessment st p 
the time that $ was being ка Te 
staff, consisting of nine assessors, used ; 1l 2 
the impressions and information soa 
from the various techniques administ > 
during the immediately preceding aie 
period in making their ratings on the Mas : 
ment Progress Study variables (see poe 
Grant, 1966, for details of the entire mens, 


METHODS OF ANALYSIS 

tistical analysis the projecti 
Ж tic: у jectiv 
test reports on 355 participants in the side ee 
coded independently by two psychologists who had 
not participated in the assessment. Using a manual 


the coders rated each report on nine variables 
e selected because of the Tie 


y with which they were used in the reports 
and were defined in terms of the descriptive phrases 
used by the psychologist jn his reports. The variables 


and their definitions were: 


For purposes of sta 


on 


Achievement Motivati 
tivated, and interested in ad- 


How ambitious, то! 
vancement and success is he? 
Seli-Confidence 
How confiden 
work? To what exten 
and anxieties concerning SUC 
Work or Career Orientation 
How important is work in this 
pared with other things, such а: 
How much satisfaction 


t is he that he will succeed in his 
t does he exhibit self-doubts 


cess? 


man's life com- 
s family and re- 
does he get 


creation? 
irom his job compared with other things in life? 
Dependence 
To what extent is he described as needing Or 
seeking help, advice, direction, and encourage- 
ment from others? 
Affiliation 
is he in being liked and accepted 


How interested 
by others, being а р: 
and avoiding 
To what ех 
situations and ! 
Optimism-Pessimism - 
How optimistic or pessimistic js he about life in 
general? How Р sitively OT negatively does he 
i X riences? How satisfied or 


Willingness (0 Assume à Leadership Role 
How ill he make decisions. and accept 
responsibility ? How 


leadership or е 
strong аге his dominance or leadership needs? 


Willingness to Accept à Subordinate Role 
How willing is he to act as a follower or sub- 
ordinate in his relationships with others? How 


suggestible and submissive is he? 


TABLE 1 
CODER RELIABILITIES 


| 
| College 


Noncollege 

sample sample 

А Г = 207 г= 145 

Projective variable (N = 207) | (N = 148) 

rij | no| му | ru 

Optimism—Pessimism 77 | 87 | 77 | 87 
General Adjustment | 34 | .85 | 80 | 89 
Self-Confidence 82 | -90 | -79 | 88 
Affiliation 89 | 94) st 91 
Work or Career Orientation | .84 | 91 | 84 | 91 
Leadership Role 84+ | 91 | 86 | 92 
Dependence 85 | 92 | 83 | 91 
Subordinate Role 81 | 90 | 82 | 90 
Achievement Motivation 87 | 93] 85 | 92 


General Adjustment 
To what extent does he indica 
(high self-confidence, 
situations and accept 
justment (low self. 
anxiety reactions, 
lems) ? 


te good adjustment 
ability to adapt to diíficult 
frustrations) or poor ad- 
confidence, insecurity, stress or 
emotional conflict, and prob- 


A 5-point Scale was used in rating each variable. 
As an example the s 


Е cale for Achievement Motivation 
is shown below: 


1—Described as ©“ 


: very low," “well below average 
or the group,” 


or “lacking” in ambition and 
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; js not 
motivation for advancement. Getting ahead 
important to him. | РЕ. 
2—Described as "somewhat below perd and 
the low side,” or “low average” in am А оз іш" 
motivation. Success in his work is К 
portant to him as other things in his Ше. 


shares equal impo ce to him 
аз achieving happiness and security. 


4 


с high 


"on th pair 


Described as “above average,” e 
side," "moderately high," or as having 
strong" ambition and motivation. e 
monetary gain, or status are important ET ting 
and he gives a fair amount of thought to 
ahead. 

5—Described as “very ambitious" О 
to get ahead” or as “very high" or he 
average." Achieving success in his work 
the most important things to him. 


ine 
r "determi" 
“well 2 d 
s ont 


grouP 
The first step in analyzing the data bod ace 
the coded reports according to the Е 
grounds of the participants. Опе group s 

men who had graduated from college un who I 
ployment (V = 207), the other of the me wh 


of 


; -ment cif 
not attended college prior to employ pn А Шш 
had been promoted to йана. с oi T. 
careers CV = 148). The great majorit) I 


were in their 20s when assessed; a few p e 
college men were in their carly 30s. Th 
from several regions of the country. е wa 
The reliability of the coding procedur he 
termined by correlating the ratings 0 


TABLE 2 
INTERCORRELATIONS or PRojective VARIABLES 
Projective variable d 2 3 4 5 
College sample (N = 207) 

Optimism— Pessimism (1) | - 73 58 23 28 
General Adjustment 2)| 73 -— 61 09 35 
Self-Confidence (3) | 58 61 —15 30 
Affiliation (H| 23 00 —15 — 13 

Work or Career Orientation (5)! 28 as 30 13 
Leadership Role (6 | 20 40 53 —36 35 
Dependence 7) | 08 22 _37 д —03 
Subordinate Role (8) 06  —03 —23 47 —02 
Achievement Motivation EE ae d uu. 

Noncollege sample (N — 148) | ` ` ` 

Optimism— Pessimism (1) = 74 61 29 06 
General Adjustment (2) 74 71 29 16 
Self-Confidence (3) 61 Fi —00 15 
Affiliation m MW) 2% 39 07 

Work or Career Orientation (3| 06 16 07 
Leadership Role (6), 33 45 —17 35 
Dependence (7) | —26 —39 23  —16 
Subordinate Role (б) | —08  —11 36  —15 
Achievement Motivation (9) 06 13 —28 50 
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lint, The S variable for each group of par- 
en was es de cac prophecy formula 
e ratings of to the correlations. i 
ting ain e the coders were pooled, and the 
: correlated m of the projective variables 
a assessment staff correlated with judgments of 
niques, and a 1 scores from other assessment 
is salary eed a in management as reflected 
spmparable 4 bie essence, the analyses made 
ue: A se for 5 sess 
5 Previously studied EE. 


resul 
Inter, 


techni 


D MENS 
dam in bed of the coding process is 
teli S between t › which presents the correla- 
| ‘abilities » he ratings and the estimated 
"à er range 4 the combined ratings. The 
omi ough a a to .04 with a median of 
able е wie reliabilities of the 
fact o variable vary somewhat from vari- 

Оу high e, they are in general satis- 


e 


sh interco,. 
бу; Correlations В 
n lations between the variables, 


The gat Tal 
e da, -able id М : 
ag “ne indic; 2, provide useful information. 
ables. ed diq i that the projective reports 
ац : hogy. iscriminate between the vari- 
of y analyzed the matrices have not been 
SUge as Correlati the variations in magnitude 
"lati at war are sufficiently great to 
“ „ ^ Ы + 
р У Small, halo" across variables 15 


e 

st 

el 
me therm T 
Ih nee: qu Several meaningful clusters 
indica matricea groupings can be observed 
Op ec by m Ап "adjustment" cluster is 
anq gist ~Pessj ne high correlations between 
CM D eve а General Adjustment, 
y dence, A “leadership” or “domi- 


Con , Cluster ўе nas 
ings eadershis indicated by the overlap be- 
* Role, ү а Dependence, and Sub- 
Cor ег V i uius a Motivation over- 
Ag lation wi er and also has а relatively 
filia ion with Work or Career Orienta- 
NU © other has relatively low correlations 
wae Sas pect particularly in the 
tq, he “ш Зере though it overlaps to some 
Rte, СОПеде inca and Subordinate Role 
and ‘most sample. Self-Confidence cor- 
; таео ШУ with Leadership Role 
атр) e, negatively, in the non- 
“m and Ga it does with Optimism- 
D elati eneral Adjustment. 
s ns between each of th 
Variables and variables Г 


e pro- 
eflect- 
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ing the evaluations of the assessment staff 
are shown in Table 3. The latter repr a 
scores based on factorial analyses of 25 cdm 
acteristics rated by the staff (Bray & Gr vnd 
1966). The characteristics were иа 4 
their relevance to the study and incl de 
managerial skills, interpersonal мет : 
general abilities, motives, values, and p^ 
titudes. The factors obtained and their den 


ignations are as follows: 

Factor Identification 
I General effectiveness 

General effectiveness 

Passive dependency 

Administrative skills 


II (college sample only) 
III (college sample only) 


IV 
y Interpersonal skills 
у 1 Control of feelings 
АШ Intellectual ability 
Work-oriented motivatio 
IX Passivity ў 
x Dependency 
Nonconformity 


XI (college sample only) 


In addition to the relationships of the pro- 
jective-report variables to scores based on the 
factors, Table 3 shows their correlations with 
staff predictions of the likelihood of progress 


in management. 
In general, the 
ing “Jeadership” 
much higher with 
those reflecting “а 
the projective variables, as ™ 
correlate higher with judged 
characteristics, that is, work-orie 
tion, passivity, and dependency, than they do 
with such ability characteristics as adminis- 
trative skills, interpersonal skills, and intel- 
lectual ability. It would appear that the pro- 
jective reports had а marked influence on the 
judgments of the assessment staffs in evaluat- 
ing the motivational characteristics of the 
participants in the study. 
That aspects of the projective reports also 
influenced the overall judgments of the as- 
sessment stafís can be seen from the relatively 
correlations of several projective vari- 
general effectiveness. (Factor 1 
prediction (will make middle 
10 or less years). Those for 
Leadership Role, Dependence, and Achieve- 
ment Motivation tend to be the highest. It 
can be noted that while the correlations 


ariables reflect- 
motivation tend to correlate 
the staff judgments than do 
djustment.” Furthermore, 
ight be expected, 
motivational 
nted motiva- 


projective v: 


high 
ables with 
and the staff 
management in 


also 
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TABLE 3 
CORRELATIONS WITH STAFF JUDGMENTS mu Em 
р Factor 
| Stat | - - = F 
Projective variable Са Ives Foul ae | 1 
Iu ш руу VI | vir уш |12 М 
| ro Er | o6 | = 
7 | 5 —10|— n 
> sample (. 207) - үө | 08 16 | {= i 
CRI EHE = n H| omoce 10 SEIEN 
General Pete " Hn oi | 5 -» s 21 
Self-Confidence 24 onl ate | ot E à 
iati —07 E 
Affiliation B Р 7 Ш 08 54 4) 5 35 
Work or Career Orientation | 21 | i 13 E 5 207 i 4 
um, | 3B | SIE IE IR IEEE TEE: 
inate Role -25 | = —12 | —2 AEE 
Ard Motivation 30 12 12 20 s 
Noncollege sample (N = 148) si s ais 02| 17 п 
Optimism—Pessimism 13 18 23 02 Quit E: 
General Adjustment 17 2 i2 | 223 08 
Self-Confidence 29 28 38 7 18 E io 2 
\ a Е 56 мб 2 
Work or Canker Orientation 22 19 22 15 2n z 3 
Leadership Role 38 -3| se| 21) 38 E 3 
pr pradenie Role E =a | 531 | =20 | 219| з 35 
уул, Motivation 40 29 28 25 Ne d ee 


with general effectiveness generally tend to be 
higher than are those with the staff predictions 
the patterns of relationship are quite similar. 

The similarity of the matrices for the two 
samples, college graduate and noncollege, 
also is worth noting. The comparability of 
"Staff Prediction” 
column is particularly marked. The similarity 
Was achieved despite differences in the educa- 


Staffs, The finding implies that although the 
assessment process is judgmental and sub- 
jective considerable Stability in the evalua- 


A clearer notion of the relative influence of 
the projective re 


were taken from Bray & Grant, 1966; the 
projective Teport correlations come from 
Table 3). 


The correlations in Table 4 were inspected 
and the highest correlation with the scores 
based on each factor and the staff prediction 
identified. The latter correlations are italicized 
in the table. 


ro" 

It is clear from these data that би nW 
jective reports made a major contr cteri tics. 
the evaluation of motivational chara and fj 
For each of these characteristics Ţ а in 
control of feelings in the поп re a a 
à projective variable has Шеш ше, 
tion. It seems reasonable to infer influ nce 
data that the assessment staff was s: xe 
by the projective reports, though ай п ^ 
sarily exclusively so, in their eva pe me 
the motivational characteristics 0 " 
assessed. -— геро и 
That the influence of the projective " е 


` asse?” per 
on the overall evaluations of the dm 
s of 


n 
А relatio ace 
sented in Table 4. The highest сог! eff 


al 9 os 
any projective variable with spen j^^ 
tiveness (Factor I) and with the 5 D 
tion are lower than those for most of t cu 
techniques, particularly the Group elatio"? py- 
and In-Basket. The projective pep M аре 
compare favorably with those uh the Ше], 
and-pencil instruments, being abou tests к 
aS those {ог the mental ability ji u 
higher than those for the persona ort 
tionnaires. . sive tos 
The correlations of the projec ochni w 
variables with other nsf cort 30 
are generally low. A majority of exceed m 
tions fall below .20. Relatively few €. W 


iyati 
and only one (Achievement Motiv 
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TABLE 4 


CORRELATION OF EACH ASSESSMENT 


METHOD WITH STAFF JUDGMENTS 


| 
A | 
Ssessment method Staff Factor 
> prediction 5 
І 7 7 7 Т 7 
ollege sample (А E P | | ПЕЧЕ ЧЕ ЕСЕ 
Manufacturi (N = 207) | | XI 
Toup Бача Problem | и "m 3 = 
-Bask Маон | zm al CAES 18| 30 | —35 | —18 
Mental 4| 60 67 | 38 62| + 31| 45 | —39 | -22 9 
Personal ДУ Test 36 22 G) D | Ка -15 u 
H y H a 7 37 2 7 7 
yy lective Questionnaire 20 m 3 2 es 79| 17 | —16| —24 | 53 
М lege sa. ont 35 as 3 21 28 |-28| 28 —43 | —29 | —41 
Manufacturine Poy = 148) 35 8 3 31] 29 | —33| 50 | —7 49 | —54 
oup Ту; g Proble: 
IP Discussion 42 go | sv | Ж |38 | 2] 39 7 
7 де 4 —43: |= 
ш. n а аера dE |а 25 
Person Ability "Test 51 so | 68 49 | 24 27| 26 | -27| 00 
Bier Questionnai 44 51 72 | 28| 32 64 | 22 —22 | —20 
ve Report i и 22 x4|» T 
5| 4 25| 5 -5 H 
ch factor and the staff prediction. 


Ote, 
Nun 
mbers 
5 that are itali 
at are italici indi " Š = 
e italicized indicate the highest correlation with the scores based on eat 


the 
Gr 
Dle) OUP Discuss 
wig "сее = in the noncollege sam- 
for nost techni n general, the correlations 
Шайы,  honco] iques are somewhat higher 
m ыш аа than for the college- 
lations wi 
a of A i other personality meas- 
ims ular interest. In general, the 
e have low correlations 
Sedo) measured by the Personal 
ети е (Edwards, 1953). Ошу 
м Шы т exceed .20 in 
NUM sample (= 207) and 13 in the 
NUS UN wl ы Жы highest 
hu 36 With De sample are .27, need Suc- 
e p? Need N pendence, college sample, 
MS "Colle urturance with Subordinate 
Tang lation Бе sample. 
ù, 1943) ms the GAMIN (Guilford & 
nd to — for the college sa™ 
al P e somewhat higher than 
elation reference Schedule. Of the 
205 кы. exceed .20, all but 2 
tween he highest correlation 15 
ееп General Adjustment ап 


Со] 
ines Be s. 


erson, 
Tr 


a 

ms the projective reports 

Ow, АП be indicative of progress in 
п Tab inferred from the correla- 

ations ; le 5. They represent aver- 
Or two groups of college- 


graduate managers with 7-9 years of service 
since being assessed and for two groups of 
noncollege managers with 8-9 years of service 
subsequent to assessment. The criterion, 
salary progress, Was determined by computing 
the difference between salary at the time of 
assessment and salary on June 30, 
is indicative of the progress in management 
made by these men up to the designated date. 

It will be noted that the projective-report 


variables which correlate highest with the 
ff evaluations (Table 3) also 
e highest correlations. with 


progress in management. This finding suggests 
TABLE 5 
CORRELATIONS WITH SALARY PROGRESS 
Projective variable аа pod 
(N = 81) (N = 120) 
Optimism—Pessimism —.01 AT 
General Adjustment ло .19* 
Self-Confidence 11 21* 
Affiliation А , —.06 0) 
Work or Career Orientation 16 17 
Leadership Role 24* `19* 
Dependence —.35* —.20* 
Subordinate Role _ =25* —23* 
Achievement Motivation 320* .30* 
*p < .05 that’ = .00. 


to 
I 
nme 


that in favoring "achievement" and “leader- 
ship” motives to those of "adjustment" in 
evaluating managerial potential the assess- 
ment stafis were interpreting organizational 
values correctly. 


Discussion 


The above results indicate that the pro- 
jective reports did make a significant con- 
tribution to the assessment of the participants 
in the Management Progress Study. The three 
projective variables which generally showed 
the highest correlations—leadership role, 
achievement motivation, and dependence—do 
not correlate as highly as do the situational 
techniques with the overall staff prediction, 
but they show about the same relationship to 
this prediction as do the mental ability 
measures. Their correlations are higher than 
are those of personality questionnaires, 

The projective Teports appear, as might be 
expected, to have particularly influenced the 
assessment staff in rating such characteristics 
as dependency, Passivity, work motivation, 
and nonconformity. The relevant correlations 
are generally clearly higher than those be- 


tween the Personality inventories and the 
staff judgments, 


Several of the projective variables are reli- 


ably related to salary progress. Those signifi- 
cant for both the college and noncollege 
groups are dependence, achievement motiva- 
tion, leadership role, and subordinate role. 
the variables also most highly related to the 
overall staff prediction. There would seem to 
be little doubt that the Projective reports do 
yield valid information regarding managerial 
motivation, 


The conditions under which the: 


se encourag- 
ing results were obtained should be noted, 


D. L. Свахт, W. Karkovskv, ann D. W. Bray 


rt 
The projective report is a л! EC 
based on three diíferent instrumen de 
report is in no way a scoring of aec 
protocols but is impressionistic А ever 
Neither is the report deeply “clinica уаз 
effort was made to orient it to the In ally, Dè 
relevant to business management. ass wines 
cause four-fifths of the reports уб таве 
һу one psychologist а question cou findings 
regarding the replicability of the 
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ployee attitudes and job 


to predict emf 
psychologist’s predic- 


Intervi 
erviews by > 
ews by psychologists were used 


perform 4 
tions үч; Correlations were computed between the 
employee ratings of their job attitudes and supervisor ratings of 


employee j А 
dicting eL. performance. The psychologists were most accurate in pre- 
least Seni р оуее attitudes toward advancement and general morale. They were 
The "du in predicting employee attitudes toward supervision and rewards. 
the Же io a were unable to predict employee performance as rated by 
Cons; 
lig, Sider: 
it able evi 
Such the a regarding the va- nates The questionnaires completed by the inter- 
7 m ; Few i елее": ot i " 
мы edinen view for various purposes age and the intervie Pt were identical 
hays Ace ng, prediction of job per- to the questionnan® completed by the psychologist 
vior ро "1d predicti ) at the conclusion of the job-concept interview. 
ion of consumer be- In sequence, the psychologist completed the job- 


Ever, las accumulat 
ed over the years. How- concept interview making extensive notes during the 
process and immediately thereafter completed the 


revie 

WS А 

ае (1964 ws of Wagner (1949) and ss an iately ‹ 

ad; nship ) suggest at best кар questionnaire reflecting. his appraisal of the inter- 

In І between i А D marg al viewee’s job attitudes and job performance. At a 
nterviewer predictions later time employees were asked to rate their job at- 


е 
Pin "Viewee "d 
avior. Certainly one ofthe _ titudes and at the same time the supervisors completed 
evaluation form. The performance 


shi à 
lp imitati 
ati : 5 
q е ons . А 
logg sheen " s is the marginal relation- the performance о 
hat the interviewee says and ratings from the supervisors and the employees 
say : А 5 т 4 
р rating. of the attitude questionnaire were obtained 
p swer any questions. 


gist present to an: 
rily so that 


dentifie 


Id be completed. y \ 
ta would be used exclusively 


that identities would 
psychologists ha 


i 
th, % { 
ап Intervi 
e rview si ; zai 
situation and his per- with a psycholo 
Each employee i 


or | 
t behavior i n 
Ыш ew i. A in future situations. 
gn "s & int. les have been designed to the analysis cou 
» rview i а 
view process, although the into ДО the da 
T or resc 


бөгү ет 

"iting y ‘Wer ht regarding the validity ^ never be disclosed. 
lhe validity} edictions and the factors established relatively good rapport with the em- 
e tel Durpo, nas shown promising results. ployees during the job-concept interviews, com- 
Meg ation, е Of this stud y ен lore plete data were collected. Attitude questionnaires 
ang em ship bet nay wes to explo were not administered to those employees who were 
| Е ween predicted and meas- not at their regular place of work at the time of 
cted administration. here were nO instances suggesting 
ration on the part of either employees 
i ires, one to 


t Така Yee j d 
Mean d j job attitudes and predi 
a lack of coopera 


d the other 


t, сере. JO 
"Че, йере formance using the job- on 
ed į lew. TH ; i or supervisors. у i 
| the hese interviews were — measure the employee job attitudes ап 
actual work situation. {ог the supervisor's ratings of subordinate’s per- 
ate Меты formance, Were developed specifically for this re- 
nM Sour OD AND PROCEDURE search project and are described in а previous 
ang? for BC ces of da . o artide by Svetlik, Prien, and Barrett (1964). 
NI whe th logists data were available for this product-moment correlations were computed be- 
NI pile Ы Purpose conducted job-concept jnter- tween the sychologist’s. predictions of employee 
Ww het ht А a of obtaining а job description јор attitudes and job performance, and the employee 
ч, se vip ined а оппанав and insight that — responses the attitude questionnaire, and the 
d Creta IS; en evant to employee attitudes supervisor's job-performance ratings. 
АЧ; qus 85) пріоуееѕ (predominantly clerks 
ber An ona ге requested to complete an RESULTS AND DrscvssioN 
e PE A "n 
е consisting of six graph zal’ An examination of the results presented in 
ositive and significant re- 


Jete 
to comple" Table 1 shows à p 


Or 
"Чаңы Pervisors 
heir subordi- 


evaluat; were requested 
uation of each of t 
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TABLE 1 
ATTITUDES 
Г z ГЕЕ-/ IDE DIMENSIONS AND PSYCHOLOGIST’S PREDICTION OF ATT) 
CORRELATION BETWEEN EMPLOYEE-ATTITUDE DIMENS i 
р Psychologist's prediction of employee attitude 
Attitude dimensions M " Advance- le] M ^ 
Supervision | Job mut Rewards ment Mora BE 
01 —.07 s v 
Employee attitude toward 06 :03 —.01 —. E e % 
supervision А " ь os 25* LAN 
Job satisfaction —01 23 08 07 a 107 13:53 
Management and com- —.04 11 22* їй DÀ i jl 
munications Е 22* 28 1% 
Rewards .22* 06 12 14 pM 10 3.11 3 
Advancement —05 .02 —.08 05 30 p 3.84 
General morale .09 20 14 .03 A3 317 
M 3.35 3.49 343 2.99 3.12 68 22 
с 47 83 -68 .60 .66 3 
Note.—N = 88, 
*p < .05. 
**p < .01 " 
n 
š А А " : erforn jon 
lationship between psychologist’s predictions supervisor’s rating of overall job P corel" pe 
of employee job attitudes and the employee One inappropriate but M ge petwee® nd 
response to the attitude-questionnaire scales appears in the off-diagonal ce : спеву ‘ob 
on four of the six scales, The degree of rela- psychologist’s prediction of jo em ploy’ 
tionship varies and is most Pronounced for the supervisor’s rating of the Qo 
attitude toward advancement and general competence. oing tha i of 
morale and lowest for attitude toward super- It would seem from the proie ace Л " 
vision. the industrial situations, the face jn P 
In predicting performance, 


the only ap- 
propriate correlation, as shown in Table 2, 


Which approaches Significance is that be- 
tween the DSychologist's prediction of job 
energy and the supervisor’s rating of the em- 
ployee on job energy. It should be noted that 
none of the Psychologist’s predictions of the 
three scales correlates significantly with the 


in Бу, 
view can serve д diagnostic puree e n 
dicting employee attitudes towa the йй 
The most valid prediction is for етей; qos 
sions of attitude toward ee ш, 
general morale, and least valid This ж 
toward supervision and rewards. о inte!" y 
Seems to be incongruous in that 010 сур 
focused on supervision receive 


TABLE 2 0109157 
CH 
CORRELATION BETWEEN SUPERVISOR RATINGS or EMPLOYEE Јов PERFORMANCE AND PSY 
RATING OF PERFORMANCE 


Psychologist ratings 
Supervisor ratings ГА 
Personnel Job Job Y 
relations competence energy x 87 
———— PP j 
Personnel relations —.03 17 10 3.69 A 
Job competence 06 45 .24* 3:79 21 
Job energy .00 .09 19 4.08 7 
Overall effort zi 05 01 3.57 
X 3.31 3.58 3.62 
s 82 84 65 
Note.—N = 95. 


Тов-СохсЕРТ INTERVIEW жым 


ота within the job situation. The 
to ditemi id not contain specific questions 
шер general morale, although ad- 
terms wa. in both absolute and in relative 
cern to p» factor of some considerable con- 
Svaluation e interviewee (this was a job- 
that their Late Many employees hoped 
eit pay Job would be rated higher and that 
sult of Анн һе increased asa direct re- 
Bates happened in the interview. 
With ti disappointing and in contrast 
'aniels (i previous research by Otis and 
View by а 50), use of the job-content inter- 
Wpraise е other than the supervisor to 
atranted, rformance would not seem to be 
em 

marie d use of the interview as an in- 
Sure Ur ing procedure seems to be 
Procedure se of the interview as a diagnostic 
“шд, to predict the more immediate 
“ронед and perception of individuals is 
by this study. This study does not 


support the use of the interview as a tech- 
nique for field-review purposes. In those situa- 
tions where the field review is used, very 
likely the reviewer will require information 
obtained from sources other than the inter- 
view situation. 
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A total of 32 mental 
vocational interest v; 
of dent 
rel 


predictor" 
be academic aptitude, 
Sides the dental GPA. The 
nificantly loaded in 3 subtests 
but 1 of the 7 "predictor" variable: 
Variable being dropped because 
loading. Of all the variables. 
important Predictor of succes 


Since the Dental A 


ptitude Testing program 
was instituted b 


y the American Dental As- 
Sociation some 20 years ago, numerous stud- 
les have been conducted to validate the test 
battery as predictors of achievement in dental 
School. Some of the studies, such as those 
by Weiss (1952) and Webb (1956), found 
moderate relationships between dental apti- 
5t scores and grades in certain courses, 
studies, including one by Layton 
(1953), found practically no relationship be- 
tween the aptitude Scores and grades in dental 
courses, 


With respect to Personality and vocational 


hompson ( 1944) found 


Graves (1942 
hand, found fairly high relati 


onships between 
a psychological variable 


and dental Student 


1The authors gratefully acknowledge 
sistance of Henry F. Kaiser, who review; 
draft of this paper and made Several v; 
gestions which have 
paper. 


the as- 
ed the final 
aluable Sug- 
been incorporated into the 


variables and the dental GPA. 
» Was significantly loaded in 4 “ 


3 


of California Medical Center, San Francisco 


manual skill, personality, and 


elieved to be potentially useful in the selection 
analyzed to determine their factor pattern in 
‚ the dental GPA. Then those variables which 
TS with the criterion variable were used as independent 
le-regression equation 
studied, it was found th 


for predictive purposes. For fuc 
at there were 2 common factor 
l factor, decided to 


predictor" variables be- 


other factor, related to manual skill, was A 
of a manual skill test and the dental GPA. Al 
s were used in the predictive equation, 1 
of its low, though statistically significant, шо, 
‚ the predental GPA was found to be the mos 
5 in dental school, 


faf 
: ere 
performance, but the relationships, © m 
from stable from year to year. In сп e 
inconsistent and sometimes confli able? у 
dence of the validity of these Va? moo 


a 
predictors of achievement in Met ов 
the present study was undertaken to varia? of 
large battery of potentially usefu licati p 
by factor analysis prior to the apP for Р ^ 
the multiple-regression technidt the Fy 
diction. This procedure accords с i ned 
gested uses of factor analysis те 
Harman (1960, p. 7). 

Purpose or STUDY (a) 


Р volo’ m 
The purpose of the study 15 inet А" ү 
to explore, by factor analysis, a terest ye 
ber of psychological, vocational "ential m 
scholastic ability variables as pote d 
dictors of success in dental schoo tion, pi 
to derive a multiple-regression "id ЕЁ, 
аз independent variables those var а а 
Shared common factors with the 
Success, the dental grade-poin 
(GPA). According to Guilford 
356), for a predictor variable t9 


6 


ах 
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validit 
y Р 
кед т. it must have at least one 
lis the Pel with the criterion variable. 
iterion of selection of the in- 


“репе 

nt vari 

uation mit mp for the multiple-regression 
mon fact hat they have at least one com- 


П factor wi 
Variable, with the dependent or predicted 


PROCEDURE 


The ont: 
to] entire 
e in a piuma class of 72 students en- 
tiy in the niversity of California School of 
Ap Djects oon year 1964-1965 was used 
est (DAT) the study. The Ss’ Dental 
verages (redo scores, their predental grade- 
Alifornia iet GPA), and their scores 
erformance Test (CPT)? were 
students! records. The DAT 
itd e routinely required of 
‚1° sum ool of dentistry. 
oral nui of 1964, the California Psy- 
y Form р" (CPI) and the Kuder Preference 
fing 2? Ss? "d Were administered to this class. 
pp uw to the end of the 
3 rom their ded year (dental GPA) were 
NUM computer cords. Data analysis was made 
alysis lations Hae one computing the 
' the Hs other performing the factor 
ў hus,” Uartimas cipal component method, fol- 
‘Tables Of this ays and Varimax rotations. 
Quanta] includeq s me correlation matrix of 33 
top titatiy, РА. S scales of the CPI; the 


paci the dentist scale o! 
varj ad hg and di the three subtests of 

e dental GPA the California Performance 
a Were ay A, the last being the criterion 
Veral age ae from 68 of the 72 5% 
que (Ванн data were incomplete. Since 
chnique ponen between traits) rather 
Саш correlation between persons) 
tests ona consists of 


Pe 
Performance Test 
g, an 


S gj 
BS от ООН molding, chalk carvin 
'ssions гаан melting was. Developed 
chool or ommittee of the University of 
Г with eme this test has been 
ё Тем carving-ability test of the 
ч p a tie nie for over 10 years. No in- 

y oth SUs reliability and validity is 
1 “Ойгат 

evel) were developed by the Institute 
һе ?pment, University of California, 
О does О or А "correlations anc 
s al the 01, 05, and -10 levels 
sucio, ee component method in 
ortho € matrix prepared by ^ 
lari zonal rotations by both 
Max solutions. 


the 
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was used, the une р 
ls qual Ns presented i 
Gn no particu 
= {ог the computer programs which eed 
en to accommodate missing data д 


FINDINGS AND INTERPRETATIONS 


Р e up with an exact stand- 
ard-error formula for testing the reliability 
of factor coefficients, the approxin ility 
formula devel - Holzinger онер 

eveloped by Holzinger and Harman 

(1941, p. 417) was used. According to thi 
formula, the standard error in the pietas 
distribution of factor coefficients for r = 18 
and N — 68 is approximately .214, where rho 
is estimated by the average of the correlation 
coefficients included in the matrix for factor- 
ing. Thus, for a factor to be significant at the 
05 level, it must be at least 2 X .214 = .428. 
Of the 496 correlation coefficients that 
entered into the matrix, 90 or 18.1% were 
significant at the .01 level, 45 or 9% sig- 
nificant at the .05 level, and 30 or 6% sig- 
nificant at the .10 level. This means that 165 
or 33.29 of all the coefficients possess some 
ignificance, giving a measure of 
he factors have not been 
d by the unreliability 


degree of s 
assurance that t 
inordinately attenuate 
of the correlation coefficients. 

Altogether 12 principal components (fac- 
tors) were extracted. Rotations by the Vari- 
max resulted їп 9 interpretable orthogonal 


factors, whereas by the Quartimax method 11 
interpretable orthogonal factors emerged. 
Both Kaiser (1958) and Wrigley, Saunders. 
and Neuhaus (1958) have found that the 
Varimax solution results in factors that have 
invariance and that are closer to 
For this reason, interpreta- 


greater 
in this study are based 


simple structure. 
tions of the factors 
on the Varimax solution. 
Of the nine factors, only two had significant 
loadings in the dental GPA, the criterion 
variable. The coefficients of the two factors 
in the 33 variables are given in Table 1. 
the three sub- 


Factor I is heavily loaded in 
tests of the California Performance Test, but 


the loading i5 barely significant in the criterion 


variable. 


The tooth, plaster, and wax subtests of the 


CPT are tests of manual skills in shaping а 
piece of clay into an oversized tooth, carving 
а cube of plaster in a specified manner, and 


ТАВГЕ 1 


MATRIX oF Two Factors WITH SIGNIFICANT Loapincs 


IN THE CRITERION VARIABLE (DENTAL GPA) 


Factor | Factor 
I п 
Percentage of Communality 9.940 | 10.500 
Dental GPA 430* | .694* 
Predental GPA —.122 -803* 
Kuder Preference Record, Form D 448 | —.024 
California Psychological Inventory 
Dominance —016 | —011 
Capacity for Status —.012 070 
Sociability 023 | —.105 
Social Presence —.086 | —.108 
Self-Acceptance —.018 051 
Well-Being 036 030 
Responsibility .032 .222 
Socialization —.073 040 
Self-Control -009 -042 
Tolerance 137 435 
Good Impression —.051 —.128 
Communality 121 118 
Achievement via Conformance —.056 A31* 
Achievement via Independence 054 221 
Intellectua] Efficiency —.061 350 
Psychological-Mindedness 005 231 
Flexibility 038 | —.085 
Femininity .023 013 
Dental Aptitude Test 
Quantitative Reasoning —.348 .443* 
Verbal Reasoning —.121 .625* 
Reading Comprehension 049 .190 
Biology 371 | —.145 
Chemistry :019 212 
Factual Information 143 :081 
Science Application 144 045 
Space Relations —.084 | —.029 
Carving Ability 301 075 
California Performance Test 
Tooth :688* | —.062 
Plaster -132* -087 
Wax -749* | — 077 


* Significant factor coefficients, 


not a measure of digital dexterity. An ex. 
amination of the complete nine-factor matrix 
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shows that the ninth factor is heavily w 
in the carving-ability test (.713) and ) sa 
ately loaded in the Cm (communality сой. 
of the CPI (—.633). The next lower (ps 
cient of this factor is found in the d P 
chological-mindedness) scale of t nificant- 
(410), which is not statistically E айл 
The significant positive and negative hu 
of this factor in the carving-ability pipol! 
the Cm scale indicate that it is а stie is 
characteristic. What this character sint 
can only be a matter of speculato 
neither the carving-ability test nor respet 
scale yields much information in gc ow 
The descriptive terms of the Cm bye erat? 
ever, such as steady, patient, an disorde™” 
for high scorers, and impatient, t thal this 
and nervous for low scorers, ae hs ctor 
is a dispositional or temperamenta’ | 


s s tion , 
Credence is lent to this interpreta arii 


-C 
dentists who feel the typical c tensio, 
testing situation generates so mu yery ^ 
that the scores on the test could stres 
reflect the testees’ affective responses. " 
rather than their true digital LL og á wi 

Table 1 shows that Factor II derate y" 
loading in the predental GPA, DAT and S 
ings in verbal reasoning of the D t^ наб. 
dental GPA, and low loadings in d achiev 
reasoning of the DAT and the Ac (@ ibe 
ment via conformance) scale of d of 
verbal and quantitative reasoning 1) ane е 
DAT are based on the V (verte operat, 
(quantitative) scores of the СА 
School and College Ability Тел, | 
The SCAT manual (Education айо 
Service, 1957, p. 6) claims that sloped ab' i 
subscores are measures of “deve in 50 js 
ties” that are related to auec aid 
learning. It thus appears that 1 in Ppt 
the academic-aptitude factor. This sigh io 
tion is reinforced by the factor 2 aid g 
loading in the Ac scale, which к и. a 
measure traits related to intellectus i 
ment in a milieu where conform ve 
requisite, 

Except for the verbal and Ew 
Teasoning tests, the Dental Ар ЕА 
Which all applicants to а denta a рге), 88 
required to take, has no validity a5 insof? pt 
of success for the sample studied, йе 
it has no common factors with 


mi 

ta 
uant qe 
de 1 até 
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GPA. Tt 

= а that the entire battery, with 
"easoning test of the verbal and quantitative 
one importan ; mo the carving test, measures 
е pre ШЫ road which is loaded neither 
. 16 Coefficient PA nor in the dental GPA. 
in Table 2 d this factor, which are given 
г is concer Ow that so far as this one 
: Practical] ned, one of the subtests would 
tery, у just as well as the entire 

, "ll examinar 
| | Wie ce of the reading-comprehen- 
E science de ig factual information, 
a" is loaded plication tests in which this 
+ factor fon reveals that recall would be a 
and, x pros in these tests. On the 
§ s test tp plays no role in the space- 
tot oading iie this factor also has a 
of pe Fecal, F us the common factor could 
Se. tests зи reflection on the nature 
With "t. to light the fact that the 
both Cotized у relationships between parts 
would be required to do well in 


acto 


all 5 
0 Pace- А 
йш. Which ar relations and the other tests, 
No tentatiy timed. For this reason this 
vely termed cognitive facility. 


othe, Sttempt. wi 
they, factors in Wy be made to interpret the 
Doi, 1€ Dot re] the nine-factor matrix, since 
Cd out, — to this study. It will be 
Кие the cot that for this sample 
kw Preferen, and the dentist scale of the 
ыр Predict, ce Record are practically use- 
32 pre School rd of student performance in 
the чог у S a matter of fact, out of the 
Gp. Tee hes used in this ‘study, only 
th th qua Sts of the CPT, the predental 
e padvantitative and verbal reasoning 
y "is the Ac scale of the CPI 
» ntal ctive value so far as achieve- 
he LM is concerned. 
"a at the efficiency of 
es is to study the valid pre- 


ari 
[I ables ; $ 
ti Actors CS in relation to the two perti- 


S. 
E dex- 


the 


m. f 
Маны mua subtest, the square © 
ij tig. subtest ficient is .473, that for te 
NL УШ, .536, that for the wax sub- 
Sy Ung, This that for the criterion variable 
teste for ав that while this factor 
o he variances of the three 


e 
extent ranging from 47.570 to 
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TABLE 2 


neo or THE CooNirIvE Faciuity FACTO 
оммох TO TESTS OF THE DAT BATTERY ui 


Factor 
Percentage of Communality 17.372 
Dental GPA 
Predental GPA б 
Kuder Preference Record, Form D ас 
California Psychological Inventory БЕ 
Dominance И — 135 
Capacity for Status 079 
Sociability ‘006 
Social Presence 1128 
Self-Acceptance —.025 
Well-Being —.078 
Responsibility —472 
Socialization — 109 
Self-Control 153 
Tolerance 133 
Good Impression 257 
Communality —.160 
Achievement via Conformance —.148 
Achievement via Independence 14 
Intellectual Efficiency —.117 
Psychological-Mindedness .322 
Flexibility .355 
Femininity —422 
Dental Aptitude Test 
Quantitative Reasoning .295 
Verbal Reasoning .386 
Reading Comprehension .666* 
Biology 629° 
Chemistry 836" 
Factual Information 671" 
Science Application 852" 
Space Relations 587 
Carving Ability 198 
California Performance Test " 
Tooth 17 0 
Plaster 237 
Wax —410 


* Significant factor coefficients. 


it only accounted for the variance 
ion variable to the extent of 
ds, 81.5% of the variance 
able was not accounted 


56.196, 
of the criter 
18.59. In other word 
of the criterion Var 
for by this one factor. 


For Factor II, the aca! 
the relevant variables are the predental GPA, 


verbal and quantitative reasoning of the DAT, 
Ac scale of the CPI, and the dental 
7 quares of their factor coefficients 
645, 391, 196, -186, and .482, respec- 
tively. In his case, the factor accounted for 
48.296 of the variance of the criterion vari- 


demic-aptitude factor, 


240 


able, and 64.5% of the variance of the pre- 
dental GPA, indicating that, of all the pre- 
dictor variables, the predental GPA is the 
most efficient. 

Confirmation of this statement was given 
by the multiple-regression equation, in which 
all but one of the seven variables which 
shared common factors with the dental GPA 
were used as independent variables. The one 
variable, the Ac scale of the CPI, was ar- 
bitrarily dropped because of its low, though 
statistically significant, factor loading. In the 
equation 


X' = 042X; + .084X, + 042X, + 480, 
—.016X, + :036Х; + .540, 


X' is the predicted dental GPA; x. the 
tooth subtest, X, the plaster subtest, and 
X; the wax subtest of the СРТ: X; the 


predental GPA; X, quantitative reasoning 
and Ху verbal reasoning of the DAT, The 


he independent vari- 


tered into the equation, 
:008, .034. It is 


Thus the loss of predictive ро 
order of .141, 
relation. 


Discussion 


A total of 33 variables was included in the 
correlation matrix from which 12 principal 
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components were extracted. Orthogonal 5 
tions for an analytic solution by the pee 
method resulted in 9 interpretable eee 
Of the 9 factors, only 2 were found Шү, 
significant loadings in the criterion ud 
the dental GPA. Factor I is identified ings 
manual skill factor, with substantial loa “th 
in the three subtests of the CPT. Facto!" 
termed the academic-aptitude factor, ^, 
significant loadings in the predental ests 
the quantitative and verbal reasoning dm 
of the DAT, the Ac (achievement vid ^^. 
formance) scale of the CPI, as well " the 
dental GPA. It was further decided ar 
carving-ability test of the DAT measu" a 
factor related to temperament rather 
simple digital skill, and that the entire ative 
battery, with the exception of quant lity’ 
and verbal reasoning and carving а be 
measures one common factor Suggest, was 
Cognitive facility. The predental б T 
found to be the most efficient prediC^. its 
the predictor variables, both in pont GPA 
common factor loading with the denta the 
and in terms of its contribution : 
multiple-regression equation. finding? 
It must be remembered that ps ether or 
apply only to the sample studied. Wi а ot het 
not the results will remain invariant t be 


У А ап 
samples from the same institution E h ar 
predicted until results of further p oi 
known. Travers and Wallace (1950), рах 


ample, have found that the DAT кк а 
little value as predictors for one Pen ist: 
University of Michigan School of ass Th 
but considerable value for another ee 

phenomenon necessitates replication jn 


Ы ч 565 
same study with succeeding clas ass 


institution, so that the effects of d 
liarities can be evaluated and арин 
consideration in the analysis of pow tl 

It is necessary, too, to keep in ™ crite” s 
best the GPA is an unsatisfactory r profs 
of academic success in any college A whe 
sional school. Many of the gra GPA pey 
enter into the computation of Que w^ 
not objectively derived, and as d 5 Pis 
reflect, in large measure, the instr" stud pe 
Sonal prejudices rather than the fact | jt 
true achievement. Because of € p 
GPA is likely to be unstable, depe” tors i 
does on the judgments of the instr" 
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Cerne; cw 
tation uf instability will result in the at- 
Utes, and sio correlations with other meas- 
е Coefficients езу in the attenuation of 
easures, Thi common factors with these 
the invalidit is fact may, in part, explain 
ticularly pe the predictor variables, par- 
qas AT battery, in this study. 
іде fa en shown that the academic- 
cd is more important to student 
à actor a school than the manual 
the first n reason for this is perhaps 
th Ticulum owes years of the typical dental 
ie technique 5565 more academic courses 
о 85 the ty courses, This automatically 
Mutation з categories of courses in the 
ius s differ the cumulative dental GPA, 
М Iients oo in the magnitude of the 
ў К the two factors probably re- 
ӨШ д ане of this. differential 
iy ОША hay ore definitive statement about 
е же, been made had it been pos- 
mized ae data on the dental GPA 
iit E to the nature of the 
ered into its computation. 
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SELF AND OTHER SEMANTIC CONCEPTS IN RELATION 
TO CHOICE OF A VOCATION ' 


RICHARD A. HUNT? 


Texas Christian Universit y 


Criterion groups (engineers, 
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managers, ministers, teachers) composed of 


i 5 semantic 
professional men judged 16 self-, other, and vocational concepts on 25 зета 


differential scales, Concept interrelation. 
normalized D score, А multiple-discri: 
functions (each P<.001) between the 
group of male undergraduates, semantic 


70 of 139 Ss 


ships were measured with a de ee 
minant analysis produced 3 тше 
criterion groups. In a cross-validatio 


differential profiles correctly classified 


according to Kuder Occupational Interest Inventory (OII) scores 


c ә t. vosi 
and 83 of 125 of these Ss according to Ist choice of vocation. Complex, rea 


life decisions 


cepts. Results support assumptions 
Rogers and Super. 


An adequate understa 


dividual selects a particular pattern of be- 
havior from among several alternatives is a 
fundamental problem, Erikson (1950, 1959) 
and Rogers (1959) have emphasized the in- 
fluence of an individual’s self-concept upon 
his complex decisions. Super (1957) has at- 
tached great Significance to the role of the 
self-concept in the development of an in- 
dividual's vocational choice. Cronbach (1960) 
States that vocational interests are an expres- 
sion of personality needs and patterns. 

The theoretical issue of this research was 
Whether complex decisions are Systematically 
related to self-concepts. The basic purpose 
WaS to investigate the relation between an 
individual's Self-concepts and his vocational 
empirical manifestation of the 
relation between personality and the decision 
process, 

The emphasis of the f 
is upon the pattern 
between Semantic con 


nding of how an in- 


ollowing hypotheses 
of interrelationships 
cepts which an in. 


I r і ased upon the author's dis- 
Sertation in partial fulfillment of requirements for 


his appreciation to Winton H. 
Chairman, and the faculty 
of the psychology department at Texas Christian 
University for helpful suggestions and encourage- 
ment in this research. Alvin J. North and Jack В, 
Strange, both of Southern Methodist University, 
have given valuable criticism of the Present manu- 
ipt. 
Sos at Southern Methodist University. 


Can be predicted from individual patterns of 


self- and other con- 


3 i f 
about the self-concept in the theories О 


dividual may hold about ИЗЕП, 
persons in his life, and esse engi ee 
type” persons such as “the typi C егеп il 
Hypothesis 1. The relationship опсерї® "i 
self-concept and other semantic С йй ро? 
be differentially related to cquo. " 
Hypothesis 2. The vocationa ; the ій i 
individuals can be predicted d g 2 
relationships between their self-c 
other concepts. 


;DUREÉ 
METHOD AND PROCEDU 

і, я ; я t the 
Semantic Differential Instrumen Р 4 


by 

Concept similarity was measures о : 
semantic differential technique dx сопсеР pog?” 
Tannenbaum, 1957). However, 29 scores 15. 
in relating the semantic differentia d n! 
(1959) theory, Osgood's D score V "After 
normalized convergence (C) score. were jul is 
D scores between all pairs of conceP Wa | m 
Íor an individual case, the C ua jvidu? 
between Concepts i and j for an 
by the following formula: 


e (Brea) t 


д core" pal 

In this scoring system a higher pce а авй "m 
greater similarity or congruence for an i в 

Concepts. In addition, the scores sé with " 
case were normalized within that E 
of 10 and a standard deviation of 2: 


mont men 
The semantic differential instru 


p 
se CO ake єй, 
Used consisted of 16 concepts. Tria тере e 
worded in a manner which v o! g 


E all | 
equally familiar and appropriate E wordinf 
jects (Ss) in the study. The ехас 
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SELF IN RELATION TO 


con 
provided а appeared іп the test booklet is 
k " 
frome нотни I intend to act or behave 
me NA Шр qu other people usually see 
self poe ш How I really feel about my- 
had e ideal p thoughts: " 
[3 opportunity. would like to be if I 


Y fath А 
the m, ег (or if you never knew your father, 


ап who 

y mother most like a father to you). 

Ог, the wom (or if you never knew your 
You) an who was most like a mother 


| 
7M 4 
Ost men: 
8M €n: The average or typical man. 


Moth 
m 


ч Ost 7 
9, Women: 
0 боа: My p The average or typical woman. 
. The average y of the Supreme Being. 
u а local or typical minister: Men who 
Wor È AVera Church as a. pastor. 
i rad typical engineer: Men who 
j cal, or the: in a mechanical, electrical, 
OF g е average er engineering speciality. 
Scion tot high S typical teacher: Men in junior 
е, chool who teach mathematics ОГ 
avera 
M, MS or ie 9r typical manager: Men in 
Chosen гу who supervise other employees. 
this Sy ЖМ ш field is —————; 
5, eld are: most people who are engaged in 


chos 
en vocational field is ———— — 


1 

Į 

Бег, 

Drof, Onally ^ 

її опайу nk most people who are not 
16, тү Vocation) ined in this field (not engaged 
lite i are: 


ер 
erso, 
n y ? P 
who has influenced me most in my 
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were enrolled in introductory Я s 
т HI study SS Hie Eo os 
concepts. On the basis of these results the 25. ча 
which showed greatest variability and аан 
between the vocational concepts were sel c em 
the experimental instrument. betea fos 
The selected scales were: rushed-leisurely, demo- 
cratic-autocratic, selfish-unselfish, idealistic-realisti 
helpful-very helpful other centered. M. 
n prm -self centered. 
very important-important, vague-precise, competi- 
tive-cooperative, very valuable-valuable, complacent- 
curious, independent-dependent, tender-tough, very 
good-good, average-outstanding, relaxed-tense, poorly 
paid-well paid, listening-talkative, generous-thrifty 
proud-humble, contented-creative, thing entered 
person centered, excitable-calm, compromising-in- 
dependent, novel-routine. 
One may question whether some of these scales 
are as truly bipolar as Osgood et al. (1957) require. 
However, the assumption concerning semantic scales 
which supports this selection procedure is that these 
scales are actually nominal representations of an 
underlying infinite continuum. For example, the sup- 
posed end points of the scale good-bad can always be 
extended to new end points by the use of superlatives. 
The scale good-very good actually represents a mag- 
nification of a segment of the good-bad scale. In 
the preliminary study Ss used all seven spaces of the 
adjective-superlative scales (e.g good-very good), 
but with the adjective-opposite pairs Ss used only 
the three spaces nearer the favorable adjective 
(e.g., the “good” end of the good-bad scale). How- 
ever, in every case the ordinal placement of the 
concepts as judged on the two related scales was 
the same. 
tic differential the 25 scales 


In the final seman ] sc 
balanced for left versus right positions 
to bottom 


ie tota] . He (she) sees me as: 
ste, 6s of 135 of the page. The concep 
R teg 9t adje Possible scales composed of ad- order within each of these clusters (a) the four 
hel] SF dean we phrases were initially СОП- selí-concepts (Concepts 1-4), (b) the five significant- 
9e, 3 & uci n from previous research (Jenkins, person concepts (Concepts 5-9), (c) the four pe 
Set of? 1958; Osgood et al, 1957). Of tional concepts (Concepts 10-13), and (d) the ree 
О was used with 89 students who individualized concepts (Concepts 14-16). 
- 
Es TABLE ! 
DESCRIPTION ОЕ OCCUPATIONAL SAMPLES 
UN , = 2 
pui ieved this 
e ^ i Number who had achieve 
n pl Age hee = educational level* Total 
occup n 
4 5 
5 3 65 
14 5 69 
35 7 66 
9 16 58 


Nati, 
1. Чоп 
z atte «i, Sducational level: 
i Ate diated lene but did not graduate fron дерге 
i Aet From E itia baccalaureate Wem jt tow d a mas ers degree. , 
СЕ ofessonal graduate school Sol with the bachelor of divinity or master's degree. 
T pragom seminary ог graduate school “а cnelor of divinity ier 
uate study beyond the mas er's О! 
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TABLE 2 
BÉ 
Occupational group ee 
Concept | F ratio --— = " уга Manager 
кыраа | Minister Engineer Teacher | 
| | | 9.48 
Acting Self versus | 3.86* 10.33 9.58 10.06 | 911 
ores | fig 8.87 10.39 9.36 | 9.80 
preme 8.03** 9.91 10.04 | 10.66 9.69 | 
ое 8.15** 8.33 9.07 | 8.61 ae 
*p <02. 
“p «01. B 
г „inatin? 
аы К araupe by ета 2 
Subjects criminations between grou[ Ы 


Four vocational criterion groups were composed of 
men who had completed basic formal academic 
preparation for their respective professions and were 
engaged in that vocation full time. Table 1 provides 
a description of these samples. 

The self-explanatory semantic differenti 
ment was distributed at professional meetings and 
by mail There were a total oí 258 usable instru- 
ments returned by the four criterion groups, 

A validation group consisted of 151 undergraduate 
students from freshmen through seniors who were 
enrolled full time at Texas Christian University. In 
addition to the semantic differential, these Ss also 
completed the Kuder (1957) Occupational Interest 
Inventory (ОП), Form D, This was scored on the 
verification key and Seven occupational keys: elec- 
trical engineer, mechanical engineer, high school math- 
ematics teacher, high School science teacher, minister, 
Personnel manager, and insurance agent. Since no 
data were available on these Ss’ postcollege voca- 
tional decisions, Scores on these scales were taken 
as the criterion of decision against which to validate 
tħe predictions from the semantic differential data. 


al instru- 


RESULTS 


Preliminary comparison of univariate anal- 
yses of variance across the criterion groups on 
each of the pairs of concept comparisons 
showed much better discrimination between 
the groups on the basis of the C scores than 


with the unmodified D Scores. Out of 136 


comparisons the F ratio for the C measure 
on a given comparison was Sreater than the 
F ratio for the corresponding D measure in 
114 instances. There were 32 instances in 
which the F ratio for the C measure led to 
statistically significant group differences (р 
= .05 or less), but the D measure failed to 
indicate group differences at the .05 leve]. 
Since the C measure provided for finer dis- 


ү 
s, it 
variability due to Ss' means and SDs; 


used in the analysis of the data. 


Hypothesis 1 


Д elf-c 

The C scores for the acting gps i 

versus the four vocational d їп i 

four criterion groups are presen groups th С 
Within each of the four criterion e 


Ше 
a : ween e 
are significant differences vean comp?" 
scores for the acting Seine concepts. үе 
with each of the four МКК "p 
In each criterion group the ccurs (e 
of congruence or Ше ae wi "m 
acting self-concept in oon represent ou? 
vocational concept which :ona [5 
h vocation?! "pe 
group. Members of eac like tbe 


е 
tend to see themselves as bos embers 0 fot 
of their own group than like n 


is study: pest 
other vocational groups in this 5 high, 
instance, in the minister group on 
C score mean is between acting го 
уегзиз тїпїзїег сопсерї. . lation 0 viet! 
Not only the differential re ;s sup | К; 
cept comparisons with groups score 0 оду 
but also the higher congruence ecified алб 
acting self-concept versus the T table of 
tional group concept gue tte” jo 
predictable pattern. The san pe ape 


inner 56, Уу 


concepts of outer self, in m 


influential person, and people t 
tional group. This pattern does st 
the remaining concepts as сотр 

four vocational concepts. 


ic 

ntl 

sema 
In a similar analysis each 


Srir IN RELATION TO 


Concept 
each co 1-4) was compared within 
ather, mothe group with the concepts of 
side of the j T, and persons within and out- 
6, 14, 15) pe ade vocation (Concepts 5, 
e criterion : differences appeared between 
91 these con groups in the C scores for each 

п each y comparisons. 

Score for th the four criterion groups the C 
Concept js a self-concept versus the father 
Similar) th igher (the concepts are more 
other e the self-concept versus the 
fem occurrin РЬ The probability of this pat- 
ons (four g by chance for the 16 compari- 
Soups) is говара in each of four 
ini concepts a: .00003. The C score between 
ы Bisnes | self versus the concept of 
hae of ele my vocation was also higher 
of 1 the same ue 16 instances of comparison 
elf-concepts versus the concept 


Ersong 

Do n addition. are not in my vocation. 
thesi 1, : to the univariate tests of Hy- 
Sprig ne gree analysis 
the four es, 1962) of differences be- 
d. The С criterion groups Was per- 
Cony ted from Pes for 40 pairs of concepts 
this Sons "om 16 x 16 matrix of concept 
Vocati alysis, ds used as the variables in 
LN na ОСЕК variables were the four 
LEM elf, ideal m versus the concepts of 
Vocation к f, influential person; people 
er, mem group, outer self, acting 
thi the voc eb, God, and comparisons 
3 analysis ational concepts. The results 
8 indicat "t shown in Table 3- This 
Concepts that the interrelationships 
Tovide з for each of the criterion 
s clear differentiation between 


lr 
Oc " 
Cupational groups. 


B = 
с TABLE 3 
S NCE OF 
> Сико тих Discrtsttnant-FUNCTION 
= SQUARE APPROXIMATIONS 


Ie | 
Percentage | 
_ | °! variance 


29 
Sy 
a ioo Vin 
Drs 


ks La = ze 
-ambda = 119, F = 5.559. “ = 120645. 


CHOICE OF VOCATION 


TABLE 4 


COMPARISON OF SEMANTIC DIFFERENTIAL AND KUDER 
OCCUPATIONAL INTEREST INVENTORY CLASSI- 
FICATIONS IN VALIDATION GROUP 


Semantic C 7 

differential Kuder ОП, Form D 
classifi- E 
cation Minister | Engineer Teacher | Manager 

g 
Minister | 18.0 5 25 6.0 
Euher | 45 | ME | TS 60 
Teacher | 90 50 75 | 1.5 
Manager | 30 11.0 6.5 | 215 
= 139, Hits = 70. 


Note.—x* = 57.99, р < .001, N 


Hypothesis 2 


On the basis 0 
analysis of the criteri 
tion analysis (Cooley 
151 undergrad 
group was made. 


semantic differenti 
probabilities of group member- 


^s differential ratio, DR, score). 
lassification proced 


he occupational 
group 


f the multiple-discriminant 
on groups, à classifica- 
& Lohnes, 1962) of the 
i validation 


of the Kuder were 
reduced to four by à the electrical and 
i s to represent 


mechanical € gi : 
the engineering group, the teacher of mathe- 


matics and teacher of science in high school 
to represent the teacher group; and the ре" 
sonnel manager an agent to rep- 
resent the manag! Kuder minister 
e representec There 


10 hits out of 139 usable cases indicate 


t statistical y dependable prediction of 
bable choice of à vocation is 
the basis of the interrelationships 
between semantic differential concepts. 
ingency coefficient of correlation be- 

analysis classification 

Suder classification is .543 compared 


үй Gams 0559 7 | 
The discriminant-analysis 


Ss in the validation group W 


classification. of 
as also compared 
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TABLE 5 


COMPARISON OF SEMANTIC DIFFERENTIAL CLASSIFI- 
CATION AND FIRST CHOICE OF VOCATION IN 
VALIDATION GROUP 


Semantic First choice of vocation 
differential | 
classifi- | 
cation | Minister | Engineer | Teacher Manager 
Minister | 22 0 0 2 
Engineer 0 26 7 7 
Teacher 1 6 13 4 
Manager | 3 9 3 22 


Note.—x? = 139.86, p < 001, N = 125, Hits = вз. 


with their first choice of occupation. Of 125 
Ss whose first choice of vocation was one of 
the four in this study, 83 were correspond- 
ingly classified on the basis of their semantic 
differential C scores. The contingency coeffi- 
cient of correlation betwi 
ables is .728 with Cnax = 866. 


Discussion 


Greater similarity or congruence between 


an individual's perception of himself and his 
perception of Specific alternatives open to him 
(such as Vocational types or areas) is related 


to his choice of a given alternative or voca- 
tion. This tends to 


cisions. As 


RICHARD A. HUNT 


such 


through his complex, real-life decisions, fe 


as in the case of vocational choice an 
cision. 

The present data provide clear & de 
of the importance of the self-concept in Ee 
tion to decisions in the natural environm 
Future research must explore more € 
the psychological nature of these relation 
in both theoretical and applied terms. 


vident 


хас 
ships 
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FACTORS IN COLLEGE ATTENDANCE ' 
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University of Hawaii 


Р У 
bose of this research was to id 
ventory, determining the decision 


Биа {тот the state university comp 
oing to College, as freshmen and ag 
Procedures yielded 13 major factors: 
Jue, Material 
Avocational Influence, 

Additional fact ү: ismissed col- 
-school samples suggeste! j 
Implications for e 


ang Reason, Academic Va 

I uence, Experience, 

4 тооц and Verbal Interest. 
ne group and 3 diverse public 

us us had considerable generality. 

aking and for further research were 


It is 
College ^ known that the decision to enter 
Кайы ateg with occupational goal, 
der, ee 1С status, family aspirations, birth 
шеп pis of college, secondary school 
Dd Other y ucational achievement, ability, 
N 15, Dail, riables (Berdie, 1954; Flanagan, 
Yman, mii Shaycoft, Orr, Goldberg, & 
об, 964; fert, 1957; McClelland, 
of 8; Saleen & Strodtbeck, 
tivation | 1962), Among investigations 
: 1957) for higher education, those 9 
heat? and " and Goldsen, Rosenberg; wil- 
Ife (© the chman (1960) are most perti- 
tie atten, present study. A decade a8? 
Orteq «Ped, unsuccessfully, to relate self- 
Teasons for going to college” to 


t М 
жое of Spindler (1955); Bid- 
innie, and Scarr (1963) an 


5 У а 
This оа) can be cited in support of а 
Sus-emergent value dichotomy: 


as concerned with the identifi- 


t 
"udin 
tion P ie wi 
ter Of maj 
1 a 
AIO to Jor factors in reasons given for the 
A Crs} attend college. It sought to show 
lon 
i this paper was presented to the 
hi roses chological Azsocation in Chi 
ip, Sant patch reported herein wis supported 
9m Cooperative Research Branch; 
of e Dar usage of Education, Department of 
Dto; сы О а 9n and Welfare (Project 
ојк tona] m inants 
WE us, sitas t 
Wiese of Stant, 


low-up study on the determ 
hoices, Joseph P. O'Reilly served 35 
Tea, the f The analysis was performed with 

nt acilities of the Statistica 


, į + A 
niversity of Hawail. 


1 and Com- 


entify factor: 
to attend college. 214 male and 306 female 


leted a 78-item inventory, 
ain as seniors. 
Social Reason, 


s, obtained from a self-report 


Reasons for 
Analyses and matching 
Conformity, Curiosity, 
Altruistic Value, School 


Value, 
Humanities 


ducational decision 


considered. 
the extent to which such factors are stable 
and generalizable to various educational 
groups. 


PROBLEM 


After a review of the literature, inter- 
s with students, and a series of open- 
ended and structured (checklist) surveys of 


undergraduate groups, Dole (1965b) proposed 
ed determinants for entering 


ibly be classified as Reasons 
Values, Interests, and In- 
d that the motiva- 


view: 


] levels, 
0,000 subjec 


the presen roblem was ap- 
E d n factor analysis. Specifically, 


ind educational-voca 
and (с) examine the gene 
of these factors. 


METHOD 


Instrument 
gate the decision to attend college, an 


or Going to College, was de- 
ies of pilot studies. Respond- 


eries 
o show the degree of importance 
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ал. 
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each of 78 reasons had in "influencing your decision 
to attend college.” Each item was rated on a four- 
step scale ranging from “very important” to “of 
no importance.” The opinionnaire items were as- 
signed logically to one of the four groupings: 
Reasons, Values, Interests, and Influences, Most of 
the Reasons items were adapted from Iffert (1957) ; 
otherwise the items had been developed as part of 
а cross-sectional study of educational and vocational 
choices (Dole, 1961). Their concurrent validity and 
their reliabilities have been discussed | elsewhere 
(Dole, 1961, 1965a). 


Sample 


The Ss included 214 male and 306 female students 
from the state university, who completed the in- 


females, 
resented over 80% of all tho. 


3 years at the University of Hawaii wi 


d evidence that Uni- 
of 1 undergraduates are much like 
State-university Populations across the country on 
standardized measures of Personality T 
stability, interests, and iti 


college, a fifth grou 
for study. This g E 


who subsequently 
low grades, 


Administration of the Inventory 


The inventory 
registration materia 
tration, 1960. Each 


they 
phrase, “So far 
and were expressed in 


Variables 


Sixty-eight of the it 
to College were selected 
were discarded because more than 90% 
in each of the four constant р; 
of no importance to the сој 
raw score on the Ohio State Psychological Examina- 
tion (Form 25) and grade-poin 


? In computing grade-point ratio, 
a value of 4, B of 3, C of 2, D of 
Total honor points were divided b 
hours for each student. 


À was assigned 
l, and F of 0. 
Y total credit 
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of the first semester were also introduced pc 
ables. It was assumed that there might entory 
academic-excellence factor among the ШҮ РЫУ 
items and that these indexes of academic 
would be related to such a factor. 


Factor Analyses 


jeted 
Product-moment correlations were сати 
among the 70 variables for the four ih A 
yielding four 70-order matrices. Bgaminato uniti 
latent roots of the full matrices (ie, a case 
in the main diagonal) revealed in cae, was COT 
Toots in excess of 1.00. Accordingly, it volved ЇЇ 
cluded that 19 common factors were анов is 
all groups. Using squared multiple me factors 
communality estimates, 19 principal 423 Equam?* 
Were extracted and rotated by Saunders 


procedure. 


Definition of Major Factors 


as 
; tor W ^ 
For purposes of this study a major (A analys 
fined as one which could be identified i ]ys 


When the factors resulting from the iw in s 
were matched. To match factors Lee T 
four different analvses the following en P d 
Observed: (a) a factor was selected a о d 
freshman group, and items with loading re 


e female у 


above were noted; (b) a factor in th da mal the 


man group was then identified which i in| 
of items with loadings over 30 gne proce nd 
items in the freshman male group; (c) : r male јр 
Was continued for factors in the senio facto. e 
senior female groups; (d) finally, VA ad! 
each group were reviewed for items W 
from .15 to 29. a 
Whenever possible each of the 70 V 
assigned to but one major factor on F 
that the variable loaded higher on tha d à 
9n any other, and, second, that it ye fre 
9n that factor of .30 or above И, hree » 
group or a loading of .15 or above in 
four groups. 1 assign? 
Aíter one of the writers (Dole) pao tors 
variables to major factors, the сы" 
reviewed independently by the other p 
discussed. Names were then assigned t 
factors on the basis of salient items, he b ? 
other studies, and suggestions furnis 
other psychologists. Each group abo 
few factors specific to the group. Thes 
called “minor factors” and will not r0" 
here. 


was 
ples 
oe 
a 2 
ctor j^ £ 
fa! joadi? 


al 
wel? 
а? 


ап. 
p mai 


idity of ur 
Finally, as a check on the vali of NE 


cedures and оп the applicability soups aye 
factors to other college freshman amd айй ed 
SPonses of the dismissed males were ae ext yo 
У inspection, the 19 factors which per y 
Were matched against the indepen 
major factors. 
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h RESULTS 
айо Analyses nant factors? In Table 1 the variables with 
their loadings have been grouped into these 


It y 
vas possib] 
e B H H area em 
to distribute the 68 in- 3 The results of these five factor analyses 
are 


Vento 
ту varia. 
bles c i i 
among 13 major d termi- presented in detail in Table G which has b 
e een 


TABLE 1 
FACTORS FROM THE l'RESHMAN AND SENIOR SURVEYS 


Loading 
Factor 
' Freshman survey Senior survey 
+ Dismissed 
Factor id Males Females Males Females 
Make heri Reason 
«Ca; rends 
De A 0 get al vios Me BETA 49 66 67 66 51 
сабор эсе with others. 45 67 62 69 58 
ы Advanta. өз-ара 53 68 1 п us 
Meet ne influential е. ке gi s 2 s 
ps Bl ee 25 41 46 38 17 
36 36 35 45 28 
19 46 38 34 
38 57 59 67 
15 33 24 18 21 
39 55 и ar e 
39 59 36 ej 15 
| 30 48 2 es 
16 6 Өз a & 
79 11 6i 65 
m 65 P 70 
21 68 i3 
" 43 23 19 
2 79 71 67 69 
" 31 23 25 
19 33 34 25 8 
к р 28 zy 
48 63 E 20 58 
42 47^ 51 58 63 
ni 42 бі 30 
руд Cademie ү, 62 63 
үйгө Study alue 5 5 40 
ее ing.. 50 45 
ML EE E 48 
Vale or^ Braduate school 24 3 7 52 
Va М of sDtitudo , chool.... 18 26 22 49 16 
ping op Реа ООСО # 5 35 33 
ay ene Заоа, on.. 35 67 25 
Mit Veo ligno ДОН 62 55 es 20 
Lire ур iud nel courses . 20 a " 
botas elf t al Value 44 m 18 
hate nosler li А Successful... 16 En 39 1] 48 
Vise, eant, eee ne 7 | 
Va or гасид im Ме 20 * ЕЕ g +2 44 
Valte gp Security. У 42 И 62 68 67 
\ op Potentia] menn БЫ i | 72 80 15 
Үш or dep, al income 67 8 18 45 44 
Ye oF adya dence, $ 46 p 59 | 80 61 
fasi men | | 
lest thin d | 17 | a з 
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TABLE 1—Continued 


Loading 
Pactor Freshman survey Senior survey 
Dismissed - 
Males Females Males үш 
"actor VII—Altruistic Value Е 55 
xs of serving others........ 43 37 60 32 62 
Value of self-improvement... . 59 47 67 30 66 
Value of parenthood. 36 60 67 47 39 
Value of religion.............. 39 52 51 33 31 
Interest in children and youth. , 18 28 28 27 
Factor VIII—School Influence . 26 
Community leaders encouraged. 57 40 67 
"Teachers thought college 65 
pr „еа аа лаа 52 60 53 57 
52 22 57 31 42 
60 38 40 56 
30 16 46 
At 49 40 
46 40 52 4T 
40 68 51 31 16 
20 33 20 " 
5 
41 41° 57 48 5 
56 24° 33 60 
32 29 31 
Interest in machines., 53 73 57 69 61 
Interest in numbers. . 66 67 51 71 72 
Interest in всїепсе..... 22 27 55 50 64 
Interest in plants and animals. . 51 17 
Factor XII—Humanities Interest 17 
Interest in music.....,, 54 63 62 69 21 
Interest in агё......... 35 43 60 27 65 
Interest in recreation. . 52 38 26 29 44 
Interest in travel. . T 38 30 32 27 
Factor XIII—Verbal Interest 36 
Influence of теайїпд........... 22 52 49 68 62 
Interest in words... 58 61 60 70 50 
Interest in ideas......0 53 42 54 66 
"actor XIV— Ability 63 
Ohio State Psychological... 25 61 64 68 6 
rade-Point Ауегаве....,..... 54 63 62 54 


Note.—Loadings below 15 not 
* Combines with Factor V in f 


major factors. The ability factor (XIV) in- 


deposited with the American Documentation In- 
stitute. Order Document No. 8521 from ADI Auxil- 
агу Publications Project, Photoduplication Service, 
Library of Congress, Washington, D. C. 20540. Remit 
in advance $2.50 for microfilm or $6.25 for photo- 
copies and make checks payable to: Chief, Photo- 
duplication Service, Library of Congress. 


a] ES 
cluded the Ohio State Psychologica jes | 
nation and grade-point-ratio Main 
none of the inventory items. pan 
factors are presented elsewhere ( nigh 
Appendix II). In spite of its. seg BP 
quency of response it was decide ее 15 a i 
the item, ^T feel that a college deg" o 
sary for the kind of work I want t° 
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recognized 
that i 
ma its emerge: 
52 белан UU as a factor (IV) 
e " à 
рор, itai pese of the dismissed male 
nd coly gs are shown i 
u i in the left- 
major factor 5 Table 1 wherever a fit with a 
dius 57 шо: identified. In the dismissed 
EOM substa of 68 inventory variables at- 
ajor in loadings on 1 of the 13 
act р inan 
or again UE factors and the ability 


Mojo, Factors Discussion 


, Thirt 

in , Uteen maj 

to Ў Questionnair factors have been identified 

atte е the рог whose items ask students 

ae cüllege ance of various reasons for 

ч When E These factors were con- 

аде апа ii among seniors in 
Ic failure ong a group dropped for 


еа, 
Ons foy, Сойере 


the m analyses 
lvations des permit clarification of 
i cational ich students reported for 
ms had LER, On an a priori 
Vsig in. nterests een classified as Reasons, 
fied a | and Influences. Factor anal- 
reclassification into 13 major 


fa Com 
Cto Pariso 
: ü А 
h identified in be fruitful between the 
чуе bee.» Othe in this research and those 
ication concer: behavioral scientists who 
ы ca al and Tned with the structure of 
CN Sew ronal motivation. Tyler * 
: results. to the resemblance be- 
X бе Yler ts reported here and her 
yl ht m & Sundb М : 
ап. cthods erg, 1964) with quite 
"d Sun е with different samples. 
Tather erg were concerned with 
inte than educational decisions. 
M and and Pied School Influence, Ex- 
( X) as ^ iei Influence 
1 Choice strategies, and Socia 


Ts Mormi 
Ц аѕ mity, and Vocational Reason 
M, Ôl) i(1962) ues 
ауе 4) апа O'Connor and Kinnane 


ise 
ussed work values that ар” 
Academic 


e t * 
Dele cla, alue, and Altruistic Value. 
ssification of Material a? 
1965. 


er. 
> Pers 
Опа] communication, 
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Altruistic V. А Р 
search on a consistent with the re- 
pulations of Gold 
(1960). Parallels are al oiden chal. 
Rosenberg’s (195 also apparent with 
intrinsi 5 58) three value complex 
rinsic reward (self-expressi plexes— 
reward (money, security ve), extrinsic 
i , y), and 
with Herzberg, Mausner. "and people—or 
(1959) extrinsic and da Synderman's 
among executives. Bidwell et А E es 
proposed that Spindler's piedi. 3) have 
traditional-versus-emergent valu ption of а 
the American culture be аса E үш 
ported determinants of анне the re- 
The Vocational Reason aud Material Value 
factors seem similar to the traditional “ше 
category, and the Social Reason, a 
and Altruistic Value factors resemble rr 
emergent value category. 
. It seems, however, that Tyler's stress on 
individuality and Super's work values are 
more congruent with the results of the present 
research than the simpler classifications pro- 
posed by Goldsen, Herzberg, Spindler, or 
Rosenberg. Two or three value" orientations 
seem quite insufficient as explanatory con- 
cepts for complex human decisions. 

Individual interviews with selected under- 
graduate students have reinforced the con- 
ception of educational decision as à result of 
three kinds of determinants—major factors, 
minor factors, and individual considerations. 
The major factors have been discussed above. 
Of the 12 minor factors which were identified 
in this study 3 were clearly common across 
three or more groups, 4 were sex related, 
and 5 were found in only one of the five 
samples. The present research has empha- 
sized the major factors, principally because of 
their generality. Of course, additional, some- 
times quite specific, factors will underlie the 
decision to attend college. The value of the 
“major factors” classification which has been 

here is that it furnishes а COD- 

which, for example, а 
counselor with his individual case might 
:tving and filling out where this 


operate, n 
seems necessary: 


ality of the Factors 
evidence that at least seven of 
tors in educational choice can 
intermediate and high 


Gener 
Additional 


the major fac 
be generalized to 
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hool samples has been obtained in three 
additional aisles (Dole, 1965a): one anal- 
ysis of 300 ninth-grade boys and girls from 
a Honolulu Intermediate school in a disad- 
vantaged area; another of 300 college-bound 
pre-science ninth-grade males of Japanese 
ancestry; and a third consisting of 1,173 
senior boys and girls from three high schools 
in Oakland, California. The samples were 
selected to emphasize diversity. The instru- 
ment, which included 39 items in checklist 
form adapted from the college inventory, ap- 
praised reasons for the choice of high school 
study program (college preparatory, tech- 
nical, business, or terminal). Conformity, 
Academic Value, Material Value, Altruistic 
Value, School Influence, Experience, and 
Science Interest emerged rather clearly as 
major factors in these public school samples. 
It was possible to match 32 items fairly 
closely with the college factors; 16 of them 
loaded significantly on similar factors in all 
eight factor analyses. Except for sex affilia- 
tion, the underlying factor Structures were 
independent of various personal and social 
Characteristics selected for analysis; they 
appeared in heterogeneous samples, including 
high school seniors from California; the items 
comprising the public school factors were 
scored by a different method (checklist) from 
the college factors (Likert) and presented in 
a different format and order; and the inter- 
relationships were measured by phi rather 
than by product-moment correlation. It is 
felt then that at least seven major f. 
have considerable generality. 


Stability 
In addition to their 


spect to other 
the stability of 


actors 


generality with re- 
groups, there was interest in 
the factors in college attend- 
ance. When the college seniors retrospected— 
“So far as you can remember now"—about 
their motivations 3 years before, most of the 
same factors emerged. Of Course, this tells 
little about the accuracy of individuals in 
recollecting, but it does Strengthen confidence 


in the substantiality of the major factors 
within groups. 


Order 


In Table 1 the major factors Were pre- 
sented according to an a priori classification 
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scheme. If the major factors. are rede 
by inspection according to size of d Cor 
for the variables, Material Value an dings 
formity generally have the highest ү Н 
Experience апі Humanities Tie, ctor 
have smaller loadings than the other fa 


CONCLUSIONS 


jent 
suffe! 
Perhaps these factor analyses are mmol 


to justify some speculations on the ri sis 
motivational structures reported as “calles? 
for educational decision. For aw con 
is primarily the path to a job pu 

comitant economic reward, while oit re 
simply conforming to family or P p 50 
Sures. In contrast, there are VER. ent 
who find gratification in the pu есш 
prise for its own sake, enjoying E i at 
inquiry or the pursuit of va acted y 
letters, and science. Some are attr all 


à ud ] the s 
Social opportunities; others xp gt 
thority of the schools: “With yo 00 


or test scores, of course you're БОЇ mbitt 
lege." Quite evidently the pais vat pe 
tions of these factors are many а relate x 
A logical next step would be ples 
13 major factors to other varia the об 
ported elsewhere (Dole, 1965а), to col, 
extracted from Reasons for Going © уу 


mu 
sca mid 
have been used as scales. These ly? 


in andl? pe 
treated as dependent variables female? ай 
differences between males and айол nd 
tween undergraduate college affi pz ege n 
between those who persisted in d, oF M 
those who later failed, transfert сое 
drew voluntarily. In general, ар? ma 
of these later studies have been 

and meaningful. 
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DETERMINANTS OF SATISFACTION IN 
MIDDLE-MANAGEMENT PERSONNEL? 


DILIP К. LAHIRI лхо SURESH SRIVASTVA 2 


Indian Institute of Management, Calcutta, India 


Responses to a questionnaire were obtained from 93 middle managers е 
Ss indicated the extent to which 13 job-content factors and 13 job-con ia 
factors contribute to the feeling of satisfaction and dissatisfaction in 


This study was concerned with determining 
the underlying sources of satisfaction and dis- 
satisfaction among employees occupying mid- 
dle-management positions, Recent views on 
job satisfaction relate to two distinct and 
separate groups of elements that act differ- 
entially as sources of satisfaction and dis- 
satisfaction: extrinsic elements in job environ- 
ment which include physical and monetary 
rewards, and intrinsic elements which fa- 
cilitate the employee self-actualization proc- 
ess. 

Although the intrinsic and the extrinsic ele- 
ments have not been empirically delineated as 
independent Structures, Herzberg, Mausner, 
and Snyderman (1959) have used this di- 
chotomy for relating job elements with satis- 
faction in their “motivator-hygiene” theory. 
Herzberg (1965b) ina recent article states: 


с at the Section of Psychology 
and Educational Sciences, Indian Science Congress 


» January 1966. 


А Calcutta ; and S. P 


to D. К. Sanyal, Director, Indian Institute of Social 


lcutta, for his 
f respondents 


, whid 
work V. B 
job dissatisfaction are those aspects of Urro gn- 


Е е > rs 
essentially describe the шша. tasks. E 
within which one performs his wor tribute, 


n t 
versely, the elements of work which duly d 
Job satisfaction are those which e те 309! 
the relationship of the worker to p а! 
task, or job content as opposed to con peor! 


In essence, the motivator-hysictt 0 n 
Suggests that the job-content a гесо 
“motivators,” such as rM 
tion, work itself, responsibility, à the self 
and other matters associated with job: 2 
tualization of the individual on s Po 
produce satisfaction; however, Ta обой, n 
factors does not produce dissatis tors 07 
the other hand, the job-context ipee pU n 
"hygienes," such as salary, social p ш 
relations aspects of the job, superV p аб | 
pany policies and administrats s. 
job security, working conditions, to the "i 
other factors somewhat peripheral n but ў d 
tend to produce job dissatisfaction y, Tor 
presence does not produce pe em r Jat 
fect, this theory suggests a aon jo ЖҮ 
ship between the job-content and dissa у 
text factors, and satisfaction and a T 
lion are not considered to be d uU 
continuum, According to this me ge pa? 
fore, one would predict that wis ofte” ШУ 
choose the job-content factors тог {bing ИД 
the job-context factors while a е ШИТ; 
fying situations, and conversely; more E 0 
text factors would be mentioned E ur 
than the content-related factors 45 
dissatisfaction. 
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таре et al. studies were followed by 
ed which have attempted to test 

ters & ^» ity of the above contentions (Cen- 
lander аре 1966; Ewen, 1964; Fried- 
Вапу’ то 4; Halpern, 1966; Malinovsky & 
Schwart ae Myers, 1964; Saleh, 1964: 
2, Jenusaitis, & Stark, 1963; Werni- 


mont 1 

Spe ДГ These results, in general, do not 
à e i n ien 

Quivoca]l- motivator-hygiene theory un 


pA Or] 
life iss aeg; Ewen (1964) found that for 
Were р С© agents some of the satisfiers 


atise related to satisfaction while others 
<atisfiers ‘Ssatisfaction and some of the dis- 
(1964 а acted as satisfiers. Saleh 
retirem E that employees in the pre- 
factors ^ Period preferred the job-context 
tont (194, 16 Sources of satisfaction. Werni- 
Sineerg ) concludes from his study on en- 
and *Xtringi Accountants that both intrinsic 
Зур SIC factors сап be sources of both 


10 1 * "n . 
"actors n and dissatisfaction, but intrinsic 
Priedas Stronger | 
а Ч E 
в. жыш (1964) found very similar ге- 
d situați und that intrinsic elements in the 
"spo. ON were important for both job 


tri, “Hon E à Ј 

a Ne ieee” Job dissatisfaction, while ex- 
abe 

(log, Sfier 


>in Becr dd in these studies cor- 
асы, ator [^ with Herzberg's concept df 
ang jS Were f Ygiene variables, while other 
ahi уел, und to include both motivator- 
ют Уре variables. Choudhuri and 
a found that for skilled workers 

he ay E factors and context-related 
ate Хасе both sources of satisfaction an 


Matiy, 


teng Ore j ‘on, but context-related factors 
(log lata Portant as satisfiers than the com 
om 5) foung CtOrs. Centers and Bugental 
"копеле that intrinsic and extrinsic job 
hi ocq Ere valued differentially at dif- 
Mang CoN ational levels. For instance, the 
Maeg Beri Population (professional and 
m | Clerical, and sales personnel) 


e 
ж value on intrinsic sources of 
ч lon. The blue-collar workers 


» ens. 
“Miskilled, and unskilled), on the 
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other hand, placed a greater value on ex- 
trinsic sources of job satisfaction. 

A number of writers have criticized the 
methods used by Herzberg et al. (Brayfield, 
1960; Ewen, 1964; Kahn, 1961; Vroom, 
1964: Vroom & Maier, 1961). These authors 
have suggested that Herzberg et al. results, 
apart from the weakness of content analysis 
of critical incidents reported during interview- 
ing situations, may be interpreted in an en- 
tirely different way. Tt is possible that stated 
sources of satisfaction may result from the 
general tendency to attribute the causes of 
satisfaction to one's own success and achieve- 
ments in the job. While in some cases sources 
of dissatisfaction may stem not from personal 
inabilities, as one may think, but from ex- 
ternal factors in the work situation, that is, 
mangagement policies or supervisor, people 
generally tend to attribute the causes of all 
failures to external objects and not to personal 
incapacities. Thus, sources of satisfaction and 
dissatisfaction may be an expression of de- 
fensive forces within an individual. 

In view of the lack of conclusive evidence 
projected in the above-mentioned studies, it 
be said that the role of the job-content 
and the job-context factors as sources 
of satisfastion and dissatisfaction 1S not 
clearly established. The purpose of this study 
is to replicate and test the motivator-hy- 
К different population and in 


giene theory in a г i 
à different culture. Specifically, this study is 
concerned with the analysis of job elements 


which contribute to the feeling of satisfaction 
and dissatisfaction in middle-management per- 


sonnel. | | 
Four hypotheses have been tested in this 


investigation. The first hypothesis is related 
to the bipolarity of the satisfaction-dissatis- 
faction dimension. The question is: do job 
satisfaction and job dissatisfaction represent 
two separate and distinct feelings and not a 
bipolar dimension on à single continuum? The 
other hypotheses are related to the question: 
do the job-content factors and the job-context 
factors act differentially in producing satis- 
faction and dissatisfaction? Do the job-con- 
tent factors act as satisfiers and the job-con- 
text factors act as dissatisfiers? The following 


hypotheses were tested: 


may 
factors 
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Hypothesis 1 


If a job factor or the positive aspect of it in А job 
situation contributes to the fecling of emp. P 
satisfaction, the lack of or the negative aspect o 
that factor will not necessarily contribute to the 
feeling of employee dissatisfaction in the same de- 
gree. Conversely, if the lack of a job factor or the 
negative aspect of it in a Job situation contributes 
to the feeling of employee dissatisfaction, the Presence 
of or the positive aspect of that factor will not 
necessarily contribute to the feeling of employee 
satisfaction in the same degree. 


Hypothesis 2 


The positive aspect of the job-content factors (or 
motivators) in a job situation will tend to contribute 
to the feeling of employee satisfaction more than the 
positive aspect of the job-context factors (or hy- 
gienes) in that job situation. Conversely, the positive 
aspect of the job-context factors (or hygienes) in a 
job situation will tend to contribute to the feeling of 
employee satisfaction less than the positive aspect of 


the job-content factors (or motivators) in that job 
situation. 


Hypothesis 3 


The lack of the job-context factors (or hygienes) or 

ct of them will tend to contribute to 
employee dissatisfaction more than 
ob-content factors (or motivators) or 
aspect of them in that job situation. 
Conversely, the lack of the job-content factors (or 
motivators) or the negative aspect of them in a job 
Situation will tend to contribute to the feeling of 
employee dissatisfaction less than the lack of the 
job-context factors (or hygienes) or the negative 
aspect of them in that job situation. 


Hypothesis 4 


The positive aspect of the job-content factors (or 
motivators) in a job situation will tend to contribute 
to the feeling of employee satisfaction, but the lack 
or the negative aspect of those factors in that job 


Situation will not tend to contribute to the feeling of 
employee dissatisfaction ; 


g of employee 
t does, it would be to a 


In addition, two other questions, Peripheral] 


to the principal hypotheses, Were examined: 
(a) Are the satisfiers and the dissatisfiers in 
different job levels identical? Are the satisfiers 
and the dissatisfiers in lower job levels (skilled 
workers) and high job levels (middle manage- 


ЮОплр К. LAHIRI AND SURESH SRIVASTVA 


s of 
ment) similar? (b) Are the two group: 
factors found cross-culturally ? 


METHOD 
Sample 


: ing middle 
Respondents were 93 executives holding justi 
management positions from a variety nh develop- 
The subjects (Ss) were attending ХРЕН ‘of Manag" 
ment programs at the Indian Institute iness ШОЛ, 
ment, Calcutta, and evening courses in зате an 
agement at the Indian Institute of er ranged P 
Business Management, Calcutta. The БЫ pe of 9 
age from 20 to 50 yr. and had a ingles rom 50 
уг. Тһе range of total job experience pes rience 
25 yr. (Mdn = 7,8 yr.) and total work exp 


5 yr. (Md! ^i 
the same position was from 2 to 15 n grad pi 
Yr). In terms of education, 67% W les 2 


геге ma^ uo 
and 33% had masters degrees. All м to midd! 
most were married (85%), and belong 
class educated families (88%). 


Questionnaire and Procedure 


; by um 
The data for this study were obtainen ined a 
of a questionnaire. This questionnaire ms conc? pts 
parts. The first part consisted of (n тезро a to 
the demographic characteristics of t one reat? ү 
The other parts of the questionnaire stisfacti 
the measures of satisfaction and dissa hosen "ges? 
different job factors, The job factors C tisfiers: ture 
study included 13 satisfiers and 13 gissa nt li pm 
26 factors were selected from differe 9; 9 jo! 
(Friedlander, 1964; Herzberg et als а short чу 
1958) and from the respondents in uring sal 
study. Four scales were used for Epp t 
tion and dissatisfaction, Two jene ith 
Measure satisfaction and dissatisfac ere de? 
Present job, while two other scales Yon 
to measure satisfaction and dissatisfa 
imaginary job. res 
Bitestlons for the first of these measu od 
follows: tionally 5 pet 
Think of a time when you felt EA or any ad 
about your present job either recent? factor j 
time. The following are some of куы of 52 
may have contributed to your fee clin 
tion at that time, Indicate by che ite’ 
extent to which each factor COD ей "m 
feeling of satisfaction on the scales £ ye the * 
Directions for the second measure iac jon ай 
except (Һе word “bad” апа ere Ж о 
Substituted for “good” and “satisfa rating iod "m 
tion to these two scales asking for yere rele so a 
Present job, the other two scales 5 се MEL 
imaginary job situations. The first a 


к of oF j 
dicate the extent to which the lack ibut e 
tive 


a 
wer? 
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(л 
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jus TABLE 1 
NTRACLASS a 
CORRELATION COEFFICIENTS FOR MOTIVATORS, HYGIENES, AND TOTAL Јов VARIABLES 


Present job 


Imaginary job 


| 
Measure | 
Motivz xui c" Ре 
Сүзө ivators | Hygiene | Total | Motivators Hygiene Total 
à on | 
Issati; Й .80* .79* | 75* * " 
isfaction 45+ | Te ER | [^ m 
<, ! 1 " 


The sats 
Wer ; dttisfacti 
"d аа qr d the dissatisíaction measures 
: Pla the satisfaction and the dis- 
бердш there were included a series of 
Е ing: & graphic scales with the end 
Чыл. Че and « Satisfaction or no dissatisfaction” 
acti о maximum satisfaction or maximum 
Tk the point the other side. The Ss were asked 
atb ne the line which showed the 
SE op 10015 as so by the respondents to each of 

© перац" 5001905 of satisfaction and the lack 
Чзаныны of the same 26 variables as 
Slaction. Thus, for each job factor 
Obtained, two for satisfaction and 
; two for the present job and 
Ew To eliminate the pos- 
~ ln ea »?" job factors were randomly 
ae hae” and 9f the four scales. This dyadic (the 

Wi b. at [ш i imaginary job) scaling tech- 

Н riedlander, 1 advantage over the other 
tio, Mdiyj akes into ac 1964; Herzberg et al, 1959) 

Опар gy lal inci account the frame of reference of 
i fad of asking his entire past voca- 
at Satish à priori assumption has been 
re a s lisflers and dissatisfiers in different 


iffer 
diss ent, 


bI У 
“igh Sian; У disse ee In some sense the 
b, Snificant ОЛЕ job factors will become 
ап the particular experience at 


RESULTS 


еар: ча 

INS action ies of the satisfaction and the 
Dare’ Ang ,,, Péasures for motivators, hy- 
al job variables were computed 
en of the Ebel’s intraclass 

ratings a (Guilford, 1954, p. 395) 

ined f from K raters. The coef- 

nam rom the data are presented 
) lt Were tested for significance 


AUR, ара 8 
ап be seen that these reliability 


estimates were sufficiently high, indicating a 
degree of consistency among the respondents 
with respect to the motivators and the hy- 
gienes as sources of satisfaction and dissatis- 


faction. 
Testing of H. ypothesis 

Table 2 gives several statistics for scores in 
satisfying and dissatisfying situations under 
the present and the imaginary job situations 
for each of the job factors belonging to the 
motivators and the hygienes. Means and 
standard deviations of satisfaction and dis- 
satisfaction scores, respectively, in the present 
job appear in Columns 1—4 and corresponding 
figures for the imaginary job in Columns 5-8. 
Mean difference (satisfaction-dissatisfaction) 
scores for the present and the imaginary jobs 
en in the last two columns. As indi- 
for 20 of the 26 factors 
(mostly motivators) the mean satisfaction 
asure was significantly higher than the 
mean dissatisfaction measure. This implies 
that the presence of any of these factors gives 
more satisfaction than the amount of dis- 
satisfaction caused by its absence. In other 
words, dissatisfaction is not the reverse of 
satisfaction for these factors and the same 
continuum cannot be advocated for measures 
these two feelings. However, 
mean amounts of satisfaction and of dissatis- 
faction for the remaining 6 job factors, 
namely, supervisor’s help, salary, fairness of 
authority, freedom of expression, recognition, 
and growth, are not significantly different 
among themselves. 

The overall results are displayed by the 

analysis of variance presented in 
‚ As expected. mean satisfaction and 
measures for all the factors 


are giv 
cated by the asterisks, 


me 


representin g 


two-way 
Table 3 
dissatisfaction 1 
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TABLE 2 
MEANS AND SrANDARD DEVIATIONS BETWEEN SATISFACTION AND DISSATISFACTION MEASURES 
FOR THE PRESENT JOB AND FOR THE IMAGINARY Jor SITUATIONS 
Present job (P) Imaginary job (I) | 
Ыы _ ы т cot ла Difference 
7 j 
Factor Satisfaction | Dissatisfaction Satisfaction | Dissatisfaction | __ 58 
| р | me Е ‘i | I 
| # | SD | и | si | и SD | ar | So | Р? | oe 
| Р : uda ie Ж Ж 
Hygienes | | | | 
Relations with co- " 2.80" 
workers 682 | 228 | 382 809 | 198 | 529 a E И 
Superior's help 612 | 282 | 5.59 741 | 2.62 | 638 0.53 | 10 
Friendliness of superior} 7.15 | 286 | 326 | 712 | 307 | 609 1.89 
Technical competence | | | 1.53" 
of superior S44 | 281 | 512 | зат | 747 | 265 | 594 | 280 | 42] 5, 
Salary 29: | 279 | 606 | 321 | 738 | 280 | | 282 | 112.) Qm 
Security | 7.29 | 2.95 453 | 327 | 829 | 241 S4 | 2.76" 12 
Working conditions | 653 3.06 | 3.24 | 245 | 7.62 | 2.48 | | 3.01 3.29" il 
Benefits 647 | 291 | 415 | 207 | 753 2.66 | | 3.06 2.32") 6 
Fairness of authority | 6.12 | 3.19 | 4.70 | 321 | 791 | 257 296 | 142) л 
Freedom of expression 5.79 | 3.03 4.82 334 7.76 2.64 | 2.69 | 27 150 
Work group 5.2 | 2.54 | 438 2.61 7.03 247 2.30 JU =, 
ын policies 5.12 | 2.67 | 6.73 2.88 | 6.59 2.96 | E d p 50 
ome life 8.00 | 253 365 | 2 3 2T | 46 | 435 
Motivators “з | 465 | 302 | 882 | 241 Ж 1,06 
Recognition 632 | 289 | sq ЖҮ = РТТ 1.32 
cx m" | 289 | 500 | 315 | 797 | 250 | @ | e и \ 
ments | $59 | 344 | 447 | 330 | тз | 249 | 556 | aas | 17, E 
Growth 6.09 | 300 | 526 | 3.25 | 7.88 231 | 706 | 291 E 20, 
Achievement 703 | 275 | 482 | 312 | $68 | 207 | 606 | 314 232" | y 
Liking for the work 700 | 241 | 468 | зз | 876 | 187 | 612 | 337 ЕГ" 
Accomplishment 7.65 | 199 | 444 | 296 | 821 2.10 | 638 | 289 | 3. or] 107 
Use of best abilities 718 | 243 | 438 | 323 | 853 | 230 | 639 | 285 А Ўр 
Responsibility 8.00 | 2.11 | 424 | 3.53 | 8.68 189 | 565 | 3.138 n a 
Autonomy 635 | 257 | 450 | 299 | 729 | 277 741 | 242 180 КЧ 
romotion 459 | 299 | 618 | 317 7.53 | 280 | 7.18 | 2.79 ur 00, 
Prestige 691 | 2.85 | 542 | 353 | вив | 224 | 735 | 2.74 boe i 
Work itself | 635 | 292 | 461 | 318 | 853 2.01 | 644 | 326 | li É 
Status $73 | 267 | 518 | 3.11 | 826 | 244 | 665 | 293 | P" 1 
ns E " i | m — 
* 5 «.05, SS ‚ W 
Р thu, sac 
Р TABLE 3 taken together differ significantly» sat e 
NALYSIS OF VARIANCE ОР SATISFACTION- porting the first hypothesis that J sep? of 
DISSATISFACTION MEASURES AND ; > ; à i re p jt. 
Моттулток-НустЕхЕ VARIABLES Gon Ex d job dissatisfaction а he ОР p £5 p 
FOR THE PRESENT Јов AND FOR and distinct feelings and not thi di ren ot” 
ae die same continuum. However, "s (Pis 
the mean scores for the two aie out NU 
7 тё, 
Factor Present job Imaginary job vators and hygienes) dp not es айе ae 
dt significant and, naturally eno P action. Jat 
MS | F | MS | r behavior of satisfaction-dissatis ^: сап ne 
Satisfaction-dis- with groups turns out to be insiġ exP е 
FO EM 1 | 1195.77 | 71.47% his insignifi difference may P^ o, w 
Motivators-ħygiene " 1.47* | 1200.71 | 97.79» — This insigni cant differe na mean? gt, 
; y, ане (V) 1| 2249] 126 | 3018] 24, in the following terms: t tisfy "h ре р) 
? Within cells 432] 943) "7 | 1329| 124 — motivators in describing the aoe of Pt 
tion are greater than the mean’ gns 


жр <.01. 


Bienes in that situation, апа the 
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[8] 
on 
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TABLE 4 
С 
OMPARISON OF MEAN SCORES BETWEEN THE GROUPS' MOTIVATORS AND HYGIENES 


1 Comment (a — .01) 


Job situation Scale E nid 
== score (d) 
4 job Satisfaction 5.59 
E job Dissatisfaction 0.82 
pow job Satisfaction 6.56 
"aginary job Dissatisfaction 474 


Difference between mean satisfaction scores for 
motivators and hygienes is insignificant. 

Difference between mean dissatisfaction scores for 
motivators and hygienes is insignificant. 


‚75 | Difference between mean satisfaction scores for 


motivators and hygienes is significant. 


40 | Difference between mean dissatisfaction scores for 


motivators and hygienes is insignificant. 


Motivators 


Situation 19 describing the dissatisfying 


n кы than the means of the hy- 
si броне E as significant differ- 
giya Чїззан £ directions on the satisfaction 
Ve tia ttisfaction scales separately may 


,, tise 

"tib Average differences apparently 
т. look ; 9 random variations above. 
a з this, paired ¢ comparisons for 
and се ТЕЕ es noted above were carried 
Under’ Tt is S are presented in Tables 4 

Sr Worth noticing in Table 4 that 


Sis, de : 
ү Sfacti Present job situation the mean 


pothesis 4 that the presence of motivators 
causes satisfaction to a greater extent than 
the dissatisfaction caused by their absence. 
However, the lack or the negative aspect of 
motivators also contributes to the feeling of 
employee dissatisfaction as shown in the re- 
sult that the mean dissatisfaction score for 
motivators differs significantly from zero. In 
other words, motivators also act as dissatis- 
fers but to a lesser extent than as satisfiers. 

With repect to hygienes, the hypothesis 
that they act more as dissatisfiers than as 
satisfiers does not stand test. The lack or the 


m dio 
tanp Vator y dissatisfaction measures for \ 
all Y differ and “hygienes” are not signifi- negative aspect of hygienes does not con- 
The Caseg mS It was also observed that in tribute to the feeling of employee dissatis- 
Wen diss lé mean satisfaction scores and faction more than the amount of satisfaction 
iy 4. hi а Usfaction scores for motivators given by its positive aspect. In fact, the re- 
am abi than those for hygienes. As shown sult shows that except possibly for four fac- 
tet t , àmong the motivators as well as tors (viz., superior’s help, salary, fairness of 
diy, S c, Bienes, the degree of satisfaction authority, and freedom of expression) hy- 
ati b eae significantly the degree of  gienes, just like motivators, act more as satis- 
o "ans 
п. The results thus support Hy- fiers than as dissatisfiers. 
C TABLE 5 
DHPARISON OF MEAN SCORES BETWEEN THE ScaLEs! SATISFACTION AND DISSATISFACTION 
N БЕ? 
Tot 
Situat; 
— Scal dien i Comment (a = .01) 
b, cale 1 
"sent Р score (d) 
Job H n . : 
№ isfaction score 15 51 nificantly greater than 
i 3.29 | Mean satisfactio s g 
“ent joh IERI ms mean dissatisfaction score. 
Magi i 3.41 | Mean satisfaction score 15 significantly greater than 
1 ч ay j fy е м i mean dissatisfaction score. 
" i i is significantly greater tha: 
i 4.23 | Mean satisfaction score 15 signi yg fi 
Say jol SS a mean dissatisfaction score. 
ee / isfaction score is significantly greater than 
i 3.66 | Mean satisiactt c 
бане n mean dissatisfaction score. 


TABLE 6 


COMPARISON OF RANKINGS OF Jon Facrons 
SOURCE OF SATISFACTION AND AS A Source 
OF DISSATISFACTION BY WORKERS AND 
Mrppre-MaNAGEMENT PERSONNEL 


Satisfaction Dissatisfaction 
Factor 
ке Middle Middle 
| Workers | manage- | Workers manage- 
| ment ment 
11.5 (13.5)| 6 5) 1 (1) 10 (24) 
11.5 (13.5) | 11 (26) 2(2) 3 (3) 
Promotion 10 (12) |i2 (27) 3 (3) 2 (2) 
Working condi- 
tions 7 (9) 4 (4) 12 (27) 
Management 
policies 8 (10) 5 (5) 1 (0) 
Recognition 9 (11) 6 (7) 5 (0) 
Relations with | | 
supervisors 5 (5) |7 (90) | 4 
Autonomy 6 (6) 8 (10) | 8 
Work itself 4 (4) офи) | 8 
Responsibility 2.5 (2.5) 10 (12) | 9 
Relations with 
co-workers 2.5 (2.5) 4 (10.5) | n (13) | 11 (25 
Security 1 (1 2 (4) | 12 (14) | 7 (17) 
rho 77+ ds 


Note.—Low numbers represent hi, 
faction and high numbers 10 ati 


n or di 
The original rankings arc ja 19% " 
i al Ings are in parenthe 


Чоп or dissatisf; 


01) between ranking of job fac 
ОЁ satisfaction 


between rankin 
dissatisfaction, The г 


common while job 
entirely different sources, 


Comparison with A merican Data 

In Table 7 and Table g are pre 
ing of job factors as sources of 
and as sources of dissatisfaction 
the American studies, 


sented rank- 
satisfaction 
obtained їп 
The present data on 
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each job item cannot be compared йеп 
with other data since the methods ow | 
ferent in different studies. ida f . 
niques were used for comparison ds in 
data. The number of overlapping fac ranks 
these studies varied from 10 to 15. Ta ; are 
reported in Friedlander's (1964) pen 
not consecutive, indicating that this 5 vest 
cluded one factor not contained in put 
study. The overlapping factors in m 5 
and each of the others were reranked cient 
case and rank-order correlation x st 
(rho) were computed and tested at te 
nificance. The values of rho appear 
bottom of Table 7 and Table 8. ‚ийїї! 
The comparisons show low and pit the 
correlations with the present study an dis 
American studies in both satisfying ns ie’ 
satisfying situations. For the Hun. апі 
the correlations were higher and sign! ic 
que ign, as. 
satisfying situations, and higher and p pion 
in 5 of the 10 cases of dissatisfying ^ ex 
The low correlations between. iic „| 
study and the American studies d m 
Indian workers and American Sl j a 
different importance on aet ure 
ments as sources of satisfaction anc 


x 5 idera? ip 
fers. The failure of the consider? ies ' 


= эы : stu the 
correlation within the American suggest тї? 
scribing dissatisfying situation 5 true jude? 
the converse is not necessarily inc 


1 ја“ 
2 zers re 
means that the American work 


me in 
j А í he 52 rs 
in these studies did not place " am 
tive importance on individual : 
describing dissatisfying situations 
а 
Discussion їй ү, 
ly 


т, 

The results of this study partly ^ онд) 
partly reject the studies mentions al. ИТ 
This study confirms Herzberg 
and Friedlander's (1964) finding? 
faction and dissatisfaction аге r1 
Dosite poles of the same feeling. as 
апа the absence or the negative 
job factor do not contribute i 
Opposite feelings, Employees W” 
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TABLE 7 
COMPARISON OR RANKING OF Јов FACTORS AS SOURCES OF SATISFACTION 
ny INDIAN AND AMERICAN WORKERS 


Sas ыы. = 
— ES == = E - 
|. Present Herzberg Schwartz | Friedlander Werni 
study (1966) | et al. (1959) | et al. (1963) | (1964) Ние 
| | Е i bs 
Job factor А т de Е | р 
| Middle Биша Supervisors Miseel- Engineers | Y t 
|. eem апа Supervisors | ү є Eng! E Accountants 
| management Accountants | tem LED aneous (N = 82) (N = 50) 
(N = 93) „Ыы; 
| (У = 203) 
"riens | 
lation yj | 
Т | А 
'uperiors Pe сб I erg | We u 10 | 9 | = | $ 
КА of (Inter. ка E 
Supe ations) | 
echni 8.5 5 б T B 
Stipes Competence of » | à | 
зыр ог 3 T 12 10.5 10 10 
S 26 6 g pa i t 
Okie | 14 14.5 10.5 ш аш 
КСМ onditions n 14 нз | й * { 
Arne, 5 Exi u ; Е = 
Freedom 91 authority na 5 = | y 
Work 9f expressio 22 Е = s _ 
Man Broup sion = — 13 = с=з 
чот (Personal life) | 1.5 14 D " ud Nu 
Conn: | | 
Сцен Чоп | 18 2 2 1 s: B 
n К D = 5 ж 
Кы "E assignments 13 7 7 | т 5 = = 
i p B ш 
устеп ah т 1 2.5 1 1 
Асов for the Work Н T 
Use a Dlishment > = = 2: 
Respo best abilitic. З а E T Е Е 
Auto зіц, S5 5 f 8 3 1 
Prot my y | 15 3 
Notig Е ее Е Е 
Л 16.5 = 
bent) M advance i 1 
Wwestig 5 4 us n 
ү HE 27 m — am 
Staty itself 9 Nu t 1 2 à 
s 16.5 3. $ — = Е 
Tho 12 8.5 ч 
.61 .56 
` Soe 76** ш 
| 82** 67 
N :92** 
ao. 
b S05 eii eal — 
е хоо; = 
“ч... 
of tain fa . 7 { 
ments like superior 5 help, security, freedom o 


Sats ator. 
е the facti 3 0f work environment as sources 
iv May not perceive the absence 
;.* aspect of the same factors a5 


recognition, and growth in the 
the assumption of some bi- 
polarity of the satisfaction-dissatisfaction 


continuum has been partially substantiated. 


Winton, emplisfaction, For job factors like 
"tis nt plo я Р өз | i 
pic ime durior da Since the job factors in these two studies do 


Dolici Ж 
es iliti Maid S UE 
ders (196. e а ыгу а уч not overlap, the questions of bipolarity with 


expression, 
present study, 
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TABLE 8 
COMPARISON OF RANKING OF Јов FACTORS As SOURCES OF DISSATISFACTION 
BY INDIAN AND AMERICAN WORKERS ee 
Present Herzherg Schwartz | Friedlander Wernimont (1966) 
study (1966) | et al. (1959) | et al. (1963) | (1964) BENE — 
| ts 
Job factor Middle Engineers А Miscel- Engineers Account 
and Supervisors | ена А82) | (= 
эдерип Accountants | (№ = 111) e cs 80) NE 
WS) ludex» Жыш: „= 
Hygienes 
Relations with co- 9 9 
workers | 25 9.5 13.5 17 a 
Superior’s help 4 F 
Friendliness of superior 5.5 5 4 8 
Technical competence of 6 6 
superior 8.5 2 5 12 : 8 
Salary 3 1 "Xd : Hf 
Security 17 15 13 » 10 
Working conditions 27 Ts 7 15.5 10 e 
Employee benefits 24 — — 18 | E 
Fairness of authority | 13 — — — | i Б 
Freedom of expression 11.5 — - — | т E 
Work group 21.5 — H 29 
Management policies E 
(Company policies) 1 1 1 6 8 í 
Home life 26 12.5 13.5 14 id 
Motivators 23 
Recognition 10 9 2 4 1 Mr 
Challenging assignments 19 — — 3 => 
Growth 5.5 9.5 15 T s E 
Achievement 11.5 11 3 2 4 A 
Liking for the work 14 -— — = = e 
Accomplishment 20 = == 5. Ф 
Use of best abilities 21.5 — - 1 А p 
Responsibility 23 12.5 10 9 3 
Autonomy 18 — — БЕ 
Promotion (Advance- E 
ment) 2 7.5 8 10 2 5 
Prestige 8.5 == Eco 5 a E 
Work itself 15 6 6 5 ? 
Status 7 14 12 = = 3, 
18 
rho 50 30 55 D [2 
64* —.33 11 11 
62* 65 98° 
` 24 
*$ «0i. Ё 
dio 
pile © (29 
respect to these job factors can neither be ac- wii be endorsed as satisfiers W? isnt aly 


cepted nor denied. 

The results of this study conflict with the 
Herzberg et al. construct of the basic two- 
dimensional nature of job attitude, In the 
Herzberg et al. conceptual framework one 
would expect that the intrinsic job factors 


mental factors are endorsed 45 „рой 89) 
The results of the present -— ak qt. 
partially that the Herzberg "rinse j^ o 
framework is workable; both in^ 4, Degg 
trinsic job factors were ium 
terminants of satisfied and diss? 
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to Ё 
Eum i Intrinsic elements, however, 
act more as с. апа extrinsic elements 
more consist gee rig These findings are 
wen (1964) Fri ү results obtained by 
E (1966). riedlander (1964), and Werni- 
золы е ѕееп from the results that re- 
ities, chic, accomplishment, use of best abil- 
ее en liking for the job, security, 
Workers ^ superior, relations with co- 
Je list whil home life ranked very high on 
In escribi : describing a satisfying situation: 
tion, restis dissatisfying situations, promo- 
Managem, ige, growth, status, recognition, 
богу Ee Policies, salary, fairness of au- 
Süperior Е ремень help, and friendliness of 
vide ranked very high on the list. It is 
“nts { ES these results that the respond- 
the fom ay endorsed job factors differ- 
tY would E at the  motivator-hygiene 
qe actor heiss predicted. | 
ios Süperior of interpersonal relations with 
Orseq , ? and the co-workers had been 


a b 
ЫШ the Ss of the present study as 


Vey. A19 

by Rimon z ) 
Hie Russian 
NUM SH ( 1 


W workers was found to be least 
between satisfied and dissatis- 
Herzberg (1965a) noted that 
Rugg Satis Was least discriminating because 
ite : indu ang dissatished workers 1П 
of n Ip. сар rated themselves аѕ highly 
(CNN Confo a with this factor. In view 
NON m among these results with 
lon 15 factor, Herzberg's (1965b) 
qae) У а that “these inversions (crossing 
cal? тергеу Biene factor to the motivator 
"n^ Ip. t the pathology of job attitude 
Wi ар may not be accepted as 


d и results of the present study are 
on E results obtained from an- 
А skilled factory workers, the 

Ws that satisfaction may come 
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from the intrinsic and extrinsic elements in 
both groups; however, dissatisfaction ге- 
sults from different sources. In both of the 
groups, extrinsic and intrinsic elements may 
act as satisfiers and dissatisfiers; for instance, 
for workers the extrinsic elements are more 
important, while for middle management the 
intrinsic elements play a major role. 

The low and insignificant correlations be- 
tween the present study and the American 
studies suggest that relative importance placed 
by the Indian and the American workers on 
individual job items are different. Such dif- 
ferences between the Indian and the American 


results are not altogether unexpected and re- 


flect cultural and social differences between 
in interpreting 


the two countries. However, 
such data one should be cautious since the 
insignificant correlations might result from the 
different techniques employed by different 
studies. 

The results obtained in this study may be 
veral possible ways. In con- 
Herzberg et al. prediction, 
Malinovsky and Barry (1965) found a posi- 
tive correlation (.55) between Factor II hy- 
gienes and overall job satisfaction. The posi- 
tive correlations between motivators and over- 
all job satisfaction, and hygienes and over-all 
job satisfaction, suggest that „both moti- 
vators and hygienes were positively related 
to job satisfaction. The results of the present 
study thus are clearly in tune with other stud- 
ies (Friedlander, 1963, 1964; Malinovsky & 
Barry, 1965: Wernimont, 1966). All these 
studies indicate that the motivator-hygiene 
theory implies а rather too rigid classification 
of job factors which contribute to satisfaction 
and dissatisfaction feelings of the employees. 

When the present study was compared with 
the results obtained from a study on skilled 
workers, it was found that the two groups 
put different emphasis 0n different job factors 
as satisfiers and as dissatisfiers. In such a 
comparison, the occupational variable, it 
seems, comes into play. In general, blue-collar 
workers had low salaries, low education, and 
low social status. Probably, to these workers, 
the need underlying the hygienes becomes 
salient. Therefore, blue-collar workers are 
more concerned and preoccupied with fulfill- 
ing the prepotent needs (security, salary, 


explained in se 
trast to the 
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good working conditions, etc.) than workers 
in higher job levels. Once these needs are 
satished the higher-order needs related to 
self-actualizing aspects of the job would 
emerge, whereas for workers in higher job 
levels who had usually higher education and 
higher social status, these prepotent needs are 
basically fulfilled, and for them the high- 
order needs become more poignant and im- 
portant. Therefore, the middle-management 
personnel found that the intrinsic factors of 
the job act more as satisfiers than do the 
extrinsic job factors. That occupational level 
is a meaningful variable in predicting need 
fulfillment has been demonstrated in Porter's 
study of job attitudes in management. Porter 
(1962, 1963) found that vertical level of 
position within management 
lation to the degree of perc 
faction and perceive 
Porter and Lawler (1965) 


Ployees’ perceived 
This explanation 
54) hierarchy of 
, blue-collar 
gratify the self- 
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thinking that these factors can provide | 
least some satisfaction. The assumpti i 
this explanation is that the prepotent д 
have been gratified in middle p 
therefore, the employees in these pag 
try to gratify the higher need, that ud e 
actualization. But if they perceive pn v 
chances to gratify this need throng i e, 
tivators are not. immediately aval m 
middle-management personnel will us they 
substitute goals despite the fact id 
do not provide true satisfaction. din the 
Another explanation could be ent ing © 
theory of cognitive dissonance. pe & 
this theory (Festinger, 1957: саная dis 
Aronson, 1960) one would experienc whid 
sonance if one fails to reach a g04 t 
one is striving. And, dissonance; mfort® 
duced, “being psychologically ae uce 
will motivate the person to try to esting?” 
dissonance and achieve consonance П he ds 
1957, p. 3]." One way of redut.. 
sonance is to shift the inner pg ext? 
it stands more realistically to t rogat" e 
environment and to find some ИР үй, 
the situation to which опе can pos th tt 
The cognition a middle manager EA б 
job situation is unpleasant ker his 
situation is not conducive to fu pies m 
order needs (motivators) is ae ET 
his cognition that he must work !! опал al 
situation. He may reduce his dime p 
least in one way, by convincing f " 
the situation is not as unpleasa? ge 
appeared. айе mane ye 
In such circumstances the m! ects” » 
would try to find many “good 25P^ 4 


э ii 
environmental factors of their p would rj 
satisfaction from them when they "1, a ША 
that the motivators become гта redut? г 
despite any expanded effort. ^? adv pe 
sonance aroused from the tack, tor рї 
ment or recognition, or other 1018 v? yin 
middle managers choose the fact? " atis" 


—the hygienes, while describing ^ jo?" 

situation. nt 
It seems that two types of yp 

may hold good, and satisfaction E: 

faction from job elements maY 

entirely different reasons than oul id" 

the motivator-hygiene theory kn f" 
To sum up, the present Stu 


-— 
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Manage 
and de personnel shows that satisfaction 
è isfaction are not on a bipolar con- 


nuu 

is is is motivators and hygienes 
Satisfaction p of satisfaction and dis- 
thus, ig a А e motivator-hygiene theory, 
tudy, ully supported in the present 
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SVIB KEY LENGTH: 
DISSIDENT DATA 
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Recent studies of interest key length Suggest that about 60 item responses аге 


Over two decades ago, without the benefit 
of IBM, E. K. Strong, Jr. took the first 
empirical stand on how many i 


tudies 15 
A limitation in these recent a ong б 
test-retest reliabilities of short an Т 
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; 
Y of using long Are the short keys as reliable 85 vi quu 
ed that every over extended periods of time? keys be 
showing a Percentage difference retest reliabilities of short and long weve" p 
» between the criterion group shown little differences. As yet, d m 
» be scored, using a vari- studies have provided any assu? . ov 
me. This procedure often short keys are as reliable as long at 
ore item responses several years. dies 15 ү 

A further limitation in these SU 7 ine 


i 0 
ore recent studies (Clark 1961; Strong, the key-len isons confoUDt., s 
я д ? g, y-length comparison effe at 
Campbell, Berdie, & Clark, 1964) indicate fects of “length of key" with the ^; Qn 
that it is unnecessary to T gd? 


1 y Score such a large “kind of key." Keys differ in бас as e 
number of item responses. Their comparisons they have different cutoff points. qu 
show that shorter unit-weighted keys are as Percentage differences—for ite™ diret pe 

м terms of both valid- — And, they differ in “length” only ЇЧ is tof 

In fact, they suggest that a function of these cutoff points; ence ш for 
number of item responses more stringent the percent айел йар уе 

validity is reduced oring key, beyond which point is, the fewer item responses ^ ter af 


Ф. 
PCS 
unc 


0 r 

м 5 е! 
scoring. As a consequence the ^ num уп 
Minnesota Voca. contain these plus an їйсгө ө в, mit 
progressively less-valid item rest dete” ke 


| ‹ S ible to E al 
v ) data this this procedure it is impossible ^ jig, 66) 
upper limit appears to be around 60-80 item whether the results are due to ап i e н 
responses length or, as Berdie and Сату ge 
tha п 
1 Based опа рарег presented to the Uni i һауе Урне Гей; Mi Eg faci ai E Г 
Minnesota Center for Interest Measurement RO. the so-called optimal таце? "e Ш? 


: QU | 
шы, Ma eap Ma 1966. The opinions ex. most-valid item responses. pen, I$ Wen 
pressed are those of the author and do not necessarily Я " ins, е", 00 
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Tésponse Кес ; 
to Debs is due to key length per se, or 
valid item at these keys contain the more- 
reason, у ы If key length is the 
"sponses ma е optimal range of 60-80 item 
in нев А used as a general guideline 

the Scr g occupational keys. However, 
àvailable, th is the number of good items 
Specife p) 161 Optimal key length would be 
will ы) -construction situation and 
н i m how many good item re- 
bases ied Longer keys would then 
items ае the pools аге rich in 
S are available. — keys where few good 


ash (19 
an 64), aware of the importance of 


Sponses 
е со 
ns 
Valid i 
item, 


апуу 

estan: P ET t ; : 

К! Ps question, attempted to 
opti factor was responsible for 


‚ Optim, 
sitis 2 "d length. He compared the 
ms equivalent P length keys comprised 
than Ver, he us T in validity. Unfortunately, 
Item Mes number of items, rather 
to the ince it Onses, as an index of key 
Tee respons, possible to score from one 
tnus Storing т each item, for the 
This al for th ey it would, in fact, be very 
akes Nasto indexes to be the same. 
Give Previous ti ae to compare 
iud is developed by first 
ndorsed item responses are differ- 
Чы Ups p by the criterion and refer- 
iq Such hs many of these should be in- 
"liable Pot e so a At one extreme there 
€asure med as to produce an un- 
$ , at the other, not 50 


Citara, TABLE 1 


S CTR 

Xs "RIST: : Р 

eo G d OF THE THREE CRITERION 
i PS INVESTIGATED 


RO 
C 


Group 


Osteo- 
paths 


Ay i c ogists | " 


43.9 37.8 
15.8 


3 
51: 585 
342 390 
348 | 171 195 


TABLE 2 

NUMBER OF EXPERIMENTAL KEYS DEVELOPED 
ғов Each Key LENGTH WITHIN EACH \ 

PSYCHOLOGIST ITEM Poor 


Key Pool 
length Ni 1 yx 
10-20 | 15-25 | 20-30 | 25-35 | 30-40 
5 | 25 | à8 | 98 5 p 
10 25 25 25 i: ° 
15 | 95 | 25 25 25 5 
20 25 25 25 25 А 
24 1 
25 25 25 14s 25 
30 25 25 25 25 
35 25 25 25 25 
40 25 25 25 8 
50 25 25 25 2 
59 : 
60 2 |2 
80 2 2 2 
93 i 
100 2 2 
150 2 2 
162 | 1 
200 2 | 
250 2 | 
255 1 
| 


» Reduced number of keys at this length due to computer 
printing malfunction. 


many as to emphasize chance differences. 
While a wide range may exist between these 
extremes, the decision made here determines 
to a great extent the key’s effectiveness. Even 
so, the evidence bearing оп this important 
decision is conflicting and inconclusive. 

The questions raised by the recent key- 
length studies provided the impetus and ob- 
jectives for this investigation. Specifically, the 
questions are: Is the superior validity of the 
shorter keys а result of the number of item 
responses in a key, or is ita result of shorter 
keys having the better items? Is there a 
maximum number of scorable item responses, 
beyond which key validity is actually re- 
duced, or are the findings due to the fact that 
only the best items have been used in the 
keys containing 60-80 items? And, last: Are 
the long-range retest reliabilities of short keys 
as high as those of long keys? 

To answer these questions it was necessary 
to use a procedure that would allow compar- 
ing the validities of keys differing in length 


but similar in all other respects. Briefly, this 


TABLE 3 
NUMBER OF EXPERIMENTAL KEYS DEVELOPED 
For Eacu Key LENGTH WITHIN Facu 
ENGINEER ITEM Poor. 


| Pool 


Key КЕ 
MEER mm | asas 20-30 

= E: 25 25 
0| 25 | | 25 ze 
15 25 25 1 
16 | - | " | ! 
20 25 25 25 

25 25 5 25 | 

30 25 | 25 5 

31 | | ЖР. 

EC 25 25 | 

40 25 25 | 

50 10 10 | 

60 5 5 | 

80 5 | 5 | 
100 5 5 | 
103 | ME NE 

150 5 | | 
200 5 
250 5 | 
256 1 | 


PROCEDURE 


The SVIB responses of current criterion groups 
and of the me; -in-genera] group furnished the data 
on which this Investigation was based.? 7 


513 engineers, 585 
genera], 


sample and two-thirds of the sam 


a 


20-yr. interva] provided S 
ing test-retest reliabilities, 
From each validati 


Percent differ. 
ence of each 


determined by 


the reference group 
that endorsed the response from the Corresponding 


percentage in the validation sample. In the usual 
manner, these percent differences Provided the neces- 


? The author is indebted to David Р. Campbell 
for making the data for this investigation available. 
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item Te 

sary data for assigning unit weights. All E i, 
sponses having positive percent meret o й- 
those that the validation sample erm ilem- 
quently, received weights of +1. po we m 
responses having negative percent differ 
ceived —1 weights. «ous "ite 

The next 2 required setting up varie al 
pools” for each occupational group. For ea ubl ed 
relatively homogeneous item pools were “mits 0 
by specifying various upper and lower end 
item validity—in this case percent differ resp 
including in the pool only those item spede? 
having a percent difference within. E group al 
range. For example, for cach sac peor ot 
the item responses showing percent ae ae in the 
Positive and negative—of 10-20 were TELA 
low validity pool. The next pool совин. 
Tesponses having percent differences pw 0 T 
25, and so оп. The percent difference lir Й “п 
Pools used, as shown in Tables 2, 3, an Not 2, 
10-20, 15-25, 20-30, 25-35, and eae r om 
Criterion groups had enough item respons pig 
large differences for the pools regu gth com 
Percent differences, In those cases, key- d 
parisons could not, of course, be vue то P 

Item responses were randomly selecte ngth$ ie 
pool for each of several different key 1008 йет 


н resi and 
Course, equivalent to the number of ner ate gout 
that pool. The resulting keys were ame 
Cross-validated | 


ап E 
on the ашула, m the $ 
samples. Only those keys obtained fr 

TABLE 4 3 

„ EVE 

NUMBER ОЕ EXPERIMENTAL KEYS Daci 
FOR EACH Key LENGTH WITHIN 

ОзткорАтн Irem POOL Р 


ore? 


Key length | л 20-20 
| 1020 | км 
ru E Md 2 
5 25 25 л 
10 25 5 р & 
15 25 | 25 ^ 
20 25 | 25 1 
25 25 25 
30 25 25 
35 25 25 
40 25 25 
50 25 15 
60 25 15 
70 | ! 
80 2 
100 2 | 
150 2 ! 
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ce ee —————. 7 
Per Cent Overlap 


* Г 175 200 E 2 
125 190 
һ 1 = 5 100 key Length 
| Median Percent overlap between reference-group distributions and оу isa sample 
istri i i i г: tion of key length. 
à distributions for the keys of each item pool as a func 
& 


^ ш dz 15 175 200 226 250 
>, y эЧ 78 D m B 
vt roup distributions and psychologist cross-validation 
Е function of Кеу length. 


Percent overlap between reference- 


Y i i pool as а 
"™ple distributions for the keys of each item [ 
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Key Length 


group distributions and engineer vali 
em pool as a function of key length. 


Fic. 3. Median percent overlap between reference- 
distributions for the keys of each it 


Per Cent Overlap 
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Key Length 
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Fic. 4. Median percent overlap between reference-group distributions and engineer 


sample distributions for the keys of each item pool as a functi 
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Ar 


175 200 


125 150 


zs 
Fig ? 5o 15 100 
" Key Length 


edian 
Koen overlap between reference-group distributions and osteopath validation sample 
stributions for the keys of each item pool as a function of key length. 


Fer Cent Overlap 


150 115 200 


125 


hi 


n 100 
та кеу Longth 
and osteopath cross-validation 


distributions 
function of key length. 


Мең 

ап 
Percent overlap between reference-group 
em pool as à 


Sample distributions for the keys of each it 
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TABLE 3 
RELIABILITIES AND TEsT-RETEST MEANS AND 
STANDARD DEVIATIONS ОР A 20-vg. 
Retest Grove (N = 197) ror 
SELECTED Key LENGTHS 


Test Retest 
Key Test-retest = 

length= correlation йй en үў ED» 
25 52 3.75) 3,17. Жан 
% 32 3.061 311' 482 
30 49 1.82 3.65 3.63 
40 .50 32H 1.22 543 
50 „82 2.68 | 5.26 EX] 
59 ST 340 6.07 6.97 
75 49 1.51 2.87 265 | 2 
25 53 £30 | 274 29 | 2, 
30 7 i ROS 3 
30 46 196 3 
35 50 —1.99 ' 3.57 
35 49 1.52 | 3.66 
40 49 L57 | 395 
40 53 1035 3,73 
50 58 | 
50 ‚60 n 
60 58 351$ 
6n Sl 00 s 
80 60 = 18 
80 64 11.20 | 
100 .60 3.82 
100 63 9.35 | 817 
150 .60 9.06 (11.84 
162 68 7.81 12.61 


ed on the psychologist 25-35%, 
and the remainder were based 


a The first six keys were bas: 
difference em-response pool, 
on the 15-25 pool, 


bercent overlap, an estimate of the proportion of 
the scores in one distribu 
in another distribution, Was use 
key validity. at each length 
is each pool, a median validation and cross- 
validati 


ation percent Overlap was computed. Next, for 
‚ Median validity—in terms of Tilton’s 
as plotted as а function of key 


es depicting these relationships for both 


validation and cross-validation RrOUDS are shown in 
Figures 1 through 6. 
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in 
held up on cross-validation of the mit 
every item-response pool and each wate ttt 
group. These data, then, steady [EE 
absence of an optimal upper limit онй 
number of item responses to score for varios 
ing maximum group separation Mete 
item-response characteristics are ese di 
across different key lengths. In fact, S e n 
indicate that considerable gains, m Jeng 
losses, are made by increasing el е 
beyond 60 item responses. These valid! 
could not be ascribed to higher item nese tt 
or any other item characteristic since Ыл eid 
fects were randomized across keys w that 8 
item pool. However, the curves sho advan 
more item responses are scared, small 
made in validitv become increasing g Ш 
This is probably due to the o meast 
culty of adding item responses tha 
previously untapped variance. e u^ 
These figures also show an ine ation 
ency for shrinkage upon к owe 
increase as key length is ipsnm) Н 
since the increments in key length asi"? 


or not the observed relationship : 
length and shrinkage is an Ud i ot 

To determine whether short dé et 
Stable as long keys over an exten уз M 
reliabilities for a selected number 0 th e 
computed for a group to whom © ter 


e 

qe 20-YT- 1 поі, 

Was readministered after а 20 Fanat of 
From the large number of key: » 24 ke 


for the psychologist criterion pM 
selected for reliability analys!s- m res 
ranged in size from 25 to 162 егеп d 
and were taken from two at тот й 
response pools. Of these, 18 we? ‚ from o 
25% difference pool and 6 werg vercen 1 
35 pool. From the keys having à А оме! 
lap representative of the media s, f "m 
each length within these two aet e у [0° 
selection of one or two keys Mr g po? at 

Only the keys within the pee А оё 
vided a wide enough range in veni AL i 
meaningful reliability compi jabilit | 
keys and their сарала. а edil i 
both item pools are shown i oses: b^ 
relevant ones, for present purp of the? 
the seventh row. Comparisons 
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> indicate that the shorter keys account 
420 5 25% of retest score variance over 
Bars кога, whereas the longest key ac- 
serious КА about 50%. These data show a 
iie i in 20-yr. retest reliabilities for 

if ч m Such results clearly indicate that 
eys are to be constructed, consider- 


able attenti 
lon should be d their long- 
tange stability e devoted to the g 


CONCLUSIONS 


Question Téspect to the optimal-key-length 
tived fren 16 Primary conclusions to be de- 
1. When these data are: 
done į en item validity is controlled, as was 
Y point 15 study, validity does not peak at 
len ie but continues to rise as the key 
ер К Teases, and no particular key length 
5 аз optimal. : 
1 H 
th the larger item pools, a virtual 


Ptote i 
onses, appears at about 100-150 item 


Sym 
тер 
n So-called “optimal point" of 60 item 
tes, bly Pl due to key length, but is 
ы Onses of to the necessity of adding item 
Чай go. l'educed validity and giving them 
S ania to the “best” item responses. 

15, therefore, a consequence of 
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unit weighting item responses and will occur 
in other situations although the actual length 
will vary as a function of item heterogeneity 
and validity. 

4. When test-retest reliability is assessed 
over a 20-yr. interval, in contrast to the previ- 
ous 30-day assessments, it appears that keys 
should contain at least 100 item responses. 


REFERENCES 


Berw, R. F, & CAMPBELL, D. P. The measure- 
ment of interests. In D. K. Whitla (Ed.), Hand- 
book of psychological measurement. Reading, 
Mass.: Addison Wesley, 1967, in press. 

Crank, K. E. Vocational interests of nonprofessional 
men. Minneapolis: University of Minnesota Press, 
1961. 

"à A. N. Development and evaluation of a 
Strong Vocational Interest Blank key for differ- 
entiating between potentially effective and less 
effective business managers. Unpublished doctoral 
dissertation, University of Minnesota, 1964. 

Ѕткохс, E. K., JR. Vocational interests of men and 
women. Stanford: Stanford University Press, 1943. 

Srnoxo, E. K., JR, CAMPBELL, D. P., BERDE, К. F., 
& CLARK, K. E. Proposed scoring changes for the 
SVIB. Journal of Applied Psychology, 1964, 48, 


75-80. 
TILTON, 

Journal of E 

656-662. 


J. W. The measurement of overlapping. 
ducational Psychology, 1937, 28, 


(Received June 27, 1966) 


Journal of Applied Psychology 


1947, Vol. 51, No. 3, 274-277 


GOAL SETTING AS A MEANS OF INCREASI 


G MOTIVATION’ 


JUDITH Е. BRYAN лхо EDWIN A. LOCKE 


American Institutes for Research, Washington Office 


On the basis of differences in performance in relation to maximal н ad 
differences in attitude ratings on an addition task, a исса оа 
motivation group were selected for 2 retests on the same task. Ил е a a 
tion group was given specific goals to reach, and the high-motiva d MS 
was told to do their best on each trial of each retest. By the end o nel s 
retest, the group given specific goals had “caught” the Do-Best ep bs 
terms of performance and in terms of favorable attitudes toward puer 
The results suggested that specific goals can be used to motivate Ss who 

a low degree of motivation to the task situation 


Previous studies of the effects of goals on 
performance and attitudes have found: (a) 
that specific hard goals produce a higher 
performance level than a goal of “do your 
best” (Locke & Bryan, 1966a, 1966b, 1967; 
Mace, 1935); (b) that hard goals yield less 
overall task liking and satisfaction than easy 
goals (Locke, 1965, 1966b); and (c) that 
specific hard goals produce more interest (less 
boredom) in the task than “Do-Best” goals 
(Locke & Bryan, 1967). In all of the above 
studies, the methodology consisted of taking 
subjects (Ss) “equated” on the dependent 
variables to begin with and attempting to 
Produce differences in these variables as a 
function of the experimental conditions, The 
Present study dealt with the same problems as 
those cited above, but the methodology chosen 
was exactly the opposite of the usual pro- 
cedure. Instead of taking Ss who were initially 
similar on the dependent measures and mak- 
ing them different, Ss were chosen who were 
initially different on these variables and 
experimental procedures were directed toward 
making them similar. 

The reason for this unusual procedure was 
to try to duplicate more closely (in one 
respect) situations typically found in in- 
dustrial and military performance situations, 
Given the low validity of presently available 
tests of “motivation” (Guion & Gottier, 
1965), it is difficult, if not impossible, to 
а reser was supported by Contract Nonr 
4792 (00) between the Office of Naval Research and 
the American Institutes for Research. The authors 
would like to thank William J. Baker of AIR for 


his many helpful comments and Suggestions relating 
to the statistical analysis of the data. 


22 motive 
select workers on the basis of their he А 
tion” in advance; thus the eum giva 
trainer is faced with the жрт terogé р 
ing workers who may be quite nem rin A 
with respect to the motivation e em Dp 
the job situation. The specific T orm ce т 
becomes one of raising the per dud rath 
the more poorly motivated indivi 
than one of selection. 
Another difference betwee differe”! үү 
ous studies was the use of four ©" Ду n 
titude measures. Except for o s by ре 
Locke (1966b), previous stu m b 
present authors had measured Gomin «бе 
of attitude (either liking or bore Үш | m 
In this study four different a ree 9 gd 
measured: boredom-interest, deg оп), | jl 
tensity of task focus (cone Т" £u 
experienced effort. It was Pre rmancê » [Н 
four types of attitudes and per cific £? 
be enhanced by giving Ss 5р 
compared to a Do-Best goal. 


gevi 
n this and P at 


PROCEDURE n 
Uu 
f 10 male io P 
T 
junteers е 


Subject Pool 


The original S pool consisted 
female paid college student vO 
University of Maryland. 


Task and Rating Scales а opie w% 


The task was simple addition, each Each 
sisting of three two-digit рее aad 
Presented with a booklet SURE each b 
sheets(s) of addition problems sid acc 
number of problems per page wi the. to 
trial length and to the atten such Y ing 
on the page. The arrangement bles 
vent Ss from keeping track of the a pa 

Separating each trial sheet was а Prost 
of four attitude rating scales. The 
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Scale " 
тА ее. vertical, graphic scale anchored 
Was Sunnis ЫШ» statements ranging from “it 
Wee two Ta A to “it was fascinating.” There 
tercentage of т Focus scales, one asking for the 
and the oth ime S felt he was focused on the task 
focusing. The asking how intensely S felt he was 
Percentage a mun scale asked S to indicate the 
uri, e trial 15 maximum possible effort exerted 
al. The S was told to rate the experience 


of ne th 
el 
а 
' nd not to make an induction from per- 


p ort 
Ormance 
; lere ү A 
: dd trials of steadily increasing length. 
?"&, follow, d ed 15 sec, Trials 5-6 were 30 sec. 
id 1,2 К by Trials 7-12 which were, respec- 
ad 30 sec. Bie 16, and 32 min. in length. The Ss 
lis. The NM trials to fill out the four rating 
fe allow + 3 и ОЁ the differing trial lengths was 
ai Dance Er ection of Ss who were similar in 
the ty") but. diff On the shorter trials ("maximal 
tis tator being pim on the longer trials, a drop on 

On to Perform. as indicative of lowered mo- 


Meno 


Test 1 
o А 
| Sie xperiment was introduced as a study 
d "s function of trial length. All Ss 
the a Ча try g do their best.” It was added that 
tria] ame amoy O work at a steady pace, exerting 
1 nt of effort per time unit on every 


Or 
teg phe origi 
i 
nipa? iste ts 20 Ss taking Test I, 12 were selec- 
Sto and IIL The six Ss having the 


cop, е кашы ш, slopes and lowest 
wing. боп fo ude scales were placed in the 
"ее ав Unifor: 5 the next two tests. The six 5s 
NI Ip Cd in mly highest scores on these measures 
Star ^ The aig ie Do-Best condition for Tests IT 

een between the two groups on 
in ‘ating scales on Test I were all 
It, Ad 4.99 7 05 level or better (ts = 2.49, 3-15, 


lisi 30 f 
К dig, of Ted Hie boredom-interest, percent focus, 
iet On М Бег and effort measures, respectively). 
e tally Test I aera the groups in total perform- 
S Ме, th A аз not significant (t= 1.34), but 
lj Cere, ©гтесү ро mance rate (in terms of mean 
Me hot Рег minute) of the low-motivation 


ч io aet lx the two groups had identical 
ШШ s re Оп the four 15-sec. trials). Thus 
bh ? but d rete of the same “maximal ability” 
mie tri | оп cir performance on the shortest 
те task © group dropped off more on the 
л : Showed less interest in and focus 


hi Go, V 

tig Оа Wo 

ite D Wag A E three wk. after taking Test I, 
0 -Best Ss returned for Test I, 


o. dengi 
к ee а to Test I. The instructions for 
bey before D were the same as those given 

Night fi est I, though it was suggested 

ind the going a little faster this 


t2 
м 
E 


TABLE 1 


GENERAL DESIGN OF THE EXPERIMENT 


Test 
Group 
| 
b ү «m ш 
Low motivation* | Do Best | Goal Goal 
High motivation? | Do Best | Do Best | Do Best 


a Motivation groups established on the basis of performance 
slopes and attitude ratings on Test 1. 


time since they had worked these same problems 
previously. The Goal Ss were told that on Test I 
they had slowed down in performance during the 
longer trials as compared to the Do-Best Ss and to 
try and improve their performance on Test II by 
trying to reach the specific goals which had been 
set for them on each trial. They were told that the 
goals on the short (15-sec.) trials were set at about 
the same place that they had reached on Test I, but 
that the goals for the longer trials were set above 
what they had done previously, since their perform- 
ance had been poorer on these trials. 

The goals for the Goal group were marked by a 
red circle placed around the problem the S was to try 
to reach by the end of the trial. These goals were 
determined by taking the mean number done cor- 
rectly by S on the four 15-sec. trials on Test I as 
the base rate and making each subsequent goal an 
appropriate multiple of this so that S would have 
to maintain his initial rate to reach each subsequent 


goal. 


Test III. Two to five wk. (M = 2.5) after Test П, 


the Goal and Do-Best Ss returned to take the 
identical test again. The instructions for the Do- 
Best group Were the same as those used in Tests I 
and II. The Goal Ss were told that they had raised 
their performance on Test II but to try to further 
improve their performance on Test III by trying for 
new goals. These new goals were set 1076 above 
their own best previous performance (on Test I or 
П) on each trial (The goals were again marked by 
red circles on the worksheets. This new method of 
setting goals was used here, because it was found 
that the method used for Test II yielded goals that 


were too hard on the longer trials. 


RESULTS 


The Ss in the Goal group were able to reach 
or beat their goals 46% of the time on Test П 
and 62% of the time on Test III. The scores 
used in all analyses (with two exceptions to 
be described below) were total problems at- 
tempted, total problems correct, and the total 
interest, focus, and effort ratings for all trials 


combined for each test. 


TABLE 2 


Fs ков AB INTERACTION BETWEEN GROUPS ACROSS 
TESTS AND FOR TEST EFFECTS WITHIN GROUPS 


| 


| F for test effects 
within groups 


F for AB 
Measure interactions === 
| Do Best | Goal 
lems attempted 3.92* 0.88 7.93** 
Me OI ries attempted | 10.00%% 162* |24.94«e* 
Problems correct | 239 1.55 8.187% 
Mean of mean correct | $620** 8.58** | 23.18** 
Interest | 2.45 3.03 1.07 
Percent focus | 4.56" 3.06 1.82 
Intensity oí focus 6.69** 6.27** 1.43 
Effort | 5.72* | 3.02 2.89 


a df for all Fs 2/20. 
* 5 < .05. 

**5 <.01. 

sp < .001. 


Table A* shows the mean correlations 
(Pearson 7’s and rho’s) of these total scores 
across tests for each group. The Goal group 
shows relatively high consistency on all the 
measures across tests, while the Do-Best 
group shows consistency only on the two 
performance measures, (There is no obvious 
explanation for their low consistency on the 
attitude measures.) 

Table B (see Footnote 2) is a summary 
matrix showing the mean Pearson correlations 
among the various Performance and attitude 
measures. For each group, the correlations 
among the raw total scores were computed 
Separately for Tests I, II, and III; and the 
correlations among change scores were com- 
Puted using the Test III-I differences. The 
Summary matrix is the average of these eight 
6 X 6 matrices an ; With one exception, is 
representative of the individual matrices. 
There was а high (though Spurious) correla- 
tion between problems attempted and prob- 
lems correct, There was no relation between 
either of the performance measures and any 
of the attitude measures, suggesting that 
Performance and attitudes Tepresented sepa. 
Tate aspects of motivation. On the other hand, 
three of the four attitude measures are highly 


? Tables A and B have been deposited with the 
American Documentation Institute. Order Document 
No. 9391 from ADI Auxiliary Publications Project. 
Photoduplication Service, Library of Congress, Wash. 
ington, D. C. 20540. it i 
microfilm or $1.25 for photocopi 
payable to: Chief, Photoduplic: 
of Congress. 
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; Я being 
related to each other, interest-boredom 


the exception. 

Mean total scores for each K 
test for each of the six measures Fi qué 
in Figures 1, 2, and 3. Generally, t yit 
show convergence across the three orna 
the Do-Best group decreasing in oe rot? 
interest, focus, and effort, and the were 
increasing on these measures. Ther i 
significant differences between the 
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Mean s 
cores o 
Whereas al] n any measure on Test IIT, 


performance arrap oai ng differences except 
€ last one e significant on Test I. On 
оа] Eis yn two trials of Test III, the 
dL poni: ean actually exceeded the Do- 
focus y PS mean on interest, intensity of 
o кас Problems correct. g 

actor кел ois, ан these changes, a two- 
P. 302; уч -measures design (Winer, 1962, 
© present A used. The F ratio of interest in 
eals any e was the AB interaction which 
and Do-Best ifferences in trends of the Goal 
0 Using „реше across tests. In addition 
Саѕцгеѕ th al scores on the performance 
Means fey О mean of the individual trial 
€ Purpose ra of these measures was used, 
s the a to weight all trials equally 
tte, ratios | к the attitude measures. 
ing од in Tabl he eight resulting measures 
Ps я anges acros e 2. Also shown are the Fs 
er r interaction. tests for each group? All 
level елаве » except those for total cor- 
0 ; Were significant at the .05 


г 


Me, etter 

the. Ures yield (The total correct and interest 

Bet evel significant AB interactions at 
0 when the above analysis was 


D ed us; 
ly y dene. the data for Tests I and III 
tep maj: aant performance interaction 
LI 9-Best BED a small quadratic trend in 

© Goa] i Up versus a strong linear trend 
iong a Tom d The attitude interactions 
te the D ar trends in opposite direc- 

Ste 4). 0-Best and Goal groups (see 


De he Tesi] Discussion 
ci ults . 
д the es Рег, this experiment indicate that 
“ation ance goals can serve to raise 
| err, ОЁ Ss who are low in the mo- 
Ro, Or th Or term , 
. 9 Ав Or these analyses was the same 
Interaction. (B X Subjects within 


d 
e Jg". the between-cell variance 
ine virtually all the between-cell 
Sin except for performance for 
D, which was predominantly 
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tivation they bring to the task. The assigning 
of specific and reasonably hard goals to ‘these 
Ss raised performance level and favored the 
development of more positive attitudes toward 
the task. On the other hand, telling the high- 
motivation Ss to do their best resulted in 
little performance increase and the develop- 
ment of increasingly less favorable attitudes 
toward the task. 

The lack of correlation between the per- 
formance and attitude measures supports the 
findings of previous research that attitudes 
and performance are not necessarily related 
(Brayfield & Crockett, 1955; Locke, 1966a; 
Locke & Bryan, 1967). 
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а А rt- 
It was found that when Ss walked on a tracking treadmill under а чш 30 
able-but-determined" (C-D) walking instructional set for a ERARA bis 
min. on each of 3 testing days: (a) Ss demonstrated a characteristic C-D pa 


that was stable on any given day; 
each other (p < 001); and (c) Ss’ 
tween Testing Days 2 and 3 (p € 01). 


A growing interest in and understanding of 
various modes of muscle activity has recently 
been experienced. The study of the char- 
acteristics of limb activity has been ex- 
panded to include: (a) the endurance of 
the leg as a function of the force applied to 
a pedal (Elbel, 1949); (5) the relationship 
between initial maximum grip strength and 
strength endurance for a fixed period of time 
(Tuttle, 1950) ; (c) the response endurance of 
different muscle groups at various fractions of 
the maximum response strength (Rohmert, 
1960); (d) the temporal components of mo- 
tion in human gait (Smith, McDermid, & 
Shideman, 1960); (e) the multidimensional 
force components of "normal" and hemiplegic 
gait (Barany, 1964); (f) the force com- 
ponents of deep knee bends (Ismail, 1964); 
and (g) the proportionate relationship of the 
sustained grip force to the maximum strength 
of the response as an index of working ef- 
ficiency and Tecovery function for various rel- 
ative loads (Caldwell, 1964). 

There have been two exciting innovations in 
the above-mentioned 
Barany's (1964; Barany & Greene, 1961) 
construction of a fo 
Measuring the bodil 
plegic patients whi 


spect to amplitu 
lateral, and vertical). The second innovation js 
found in Caldwell’s (1963, 1964) research in 
which he has refined a techni 


1 Now psychology research 
struments, Inc., Dallas, Texas, 


que employing 


director at Texas In. 


5 (b) Ss’ C-D pace differed statistically d 
C-D pace measures were most reliable be 


е demo? 


; in th jd 
relative loading which resulted in dura 


stration that differences in Le 4 
were unrelated to differences in conduct > 

The prior treadmill research E Lo 
this laboratory by Evans (1962, к jtrat! 
developed a technique ulane ra 
schedule to measure performance scula 
a function of continuing heavy UR Ў 
tion, and Caldwell's research, uti 16 at 
manual response, led to the lize 3 
treadmill could conceivably be Ч «elati 
vestigate the application of the to the 
Proportional loading” technique involv? 
namic muscle group responses 
walking. 

Before relative loading can { 
Pace, а valid and reliable point © „palo 
must initially be determined (CF а): phe 
to Caldwell’s maximum grip at whi Ку 
tially it was felt that the poin uid уйе! 
subject (S) broke into a run ЖО 
a measure. Several pilot studies; 
gested that such a measure тау pilit” yel 
the necessary validity and wem tbe al 
variety of reasons: (a) the eee итш, (i) 
mill task just preceding the п tori ап oul 
Measure was a confounding pq go 
the particular instructions ent al” 
to influence the maximum Т ме ma E 
among other problems, the trea ced the А 
speed of 6.5 mph did not exc t 
of the fastest walker. det 

In view of the above it was t- 
evaluate 55 “comfortable-bu valid 
(C-D) walk in the hope на ре 
liable “characteristic” pace hat Ss 
If it could be demonstrated а it Ж 
Stable characteristic pace the 


eh 


dy 
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Possi i 
d Eon increase or decrease the pace by 
Din age to study various measures of 
ne and endurance. 
e 
Ked. орана therefore of the present re- 
i iis to determine: (a) if individuals 
iced aracteristic pace; and (b) if the 
1S stable over time. 


Mz 
[ETHODS AND PROCEDURES 


Abparatus 
The 
ap 
M ien Was essentially that described by 
Deed › With a few modifications. The variable 


(Ls 
tee. The o treadmill was set at a 0.0% 
rs Usual appli ene of the treadmill, which in 
chang Тїп, was а is manually set to a fixed speed 
one ical COuplin Phuected by an appropriate me- 
spe, tection 4 © а reversible electric motor. In 
ао Contro] of ü rotation Ў this motor drove the 
of lion or th de treadmill to produce a constant 
ion ( E € treadmill. In the other direction 
p red control produced a constant 
n sequ. енн motor was set to 
Fir min/scc n or deceleration of the tread- 


e Е 
оп уа: 
of the Ns (1963) study, the direction of rota- 


Ог n 
trea mi etch held by S as he walked on 
tn leceler. hen S depressed the switch, the 
that Айт m ated; when S released the switch, 
accelerated. This arrangement required 


In 
ШЇ 

siti А 
lip Ор 


th, 
thet 


[Г а fun 

i iy, s es а constant speed. If, howeven 

e 9), Sing (either length of stride or steps 
Switch * he would move forward on the 

hig at Posed be pulled to the accelerate 
ih 6 the ү ЧОП, and the A-D drive would 


5 u е tr 3 
Wettin e the ЛЧ to match speed with S, at 
tral 


preadmill, 
umber 3) iti d 
dec position, an 
that ор егаќе the treadmill until its speed 
5 pace. Earphones with muffs an 
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a low-level (10 db.) white noise were em 
mask the noise of the activated A-D кер 
that the primary cues to walking pace would be of a 
proprioceptive mode. To further control extraneous 
cues, S was instructed to look straight ahead and the 
e na speed сш handle on the side of the tread- 
mill was covered, as w; 
е waas 3 as the front edge of the tread- 
A continuous tracing of treadmill speed obtained 
from a tachometer generator attached to the tread- 
mill drive was recorded graphically with a Mosele: 
Model 680 strip chart recorder. P 
The advantages of the above procedures are: (a) 
S is not forced to respond to the continual A-D 
implicit in the titration schedule approach; (b) the 
speed track of the treadmill should be narrower, more 
closely following the natural accelerations and de- 
celerations of normal walking; and (c) extrancous 
cues which might influence the walking pace are 


minimized. 


Subjects 


Nineteen male Ss who had just completed 6-mo. 
basic training were employed in this investigation. 
The Ss, whose average age was 19.7 yr., wore regula- 
tion fatigue pants, tee shirts, and combat boots 
(average weight 5.5 Ibs.). Walking was performed in 
a temperature-controlled chamber at 80° F. 


Procedure 

rior to the data-taking sessions, 
each S walked for 30 min. on the treadmill for 
familiarization. The purpose of the familiarization was 
to allow Ss to become adapted to walking on the 
treadmill and to become adjusted to the accelerating 
and decelerating of the treadmill as it matched their 


pace. 

The tas! 
ing was as follows: (& 
either a fast walk (5 
during which Ss ei 
their pace to reach their 
mined" (C-D) walking pace; (b) a 30-min. walk at 
their C-D pace; and (c) two short walks again 
starting from either a fast or a slow walk to adjust 
their pace to reach their C-D pace. For Group I, the 
short pre- and postwalk (fast start then slow start 
or slow start then fast start) was randomly deter- 
mined and the walk lasted 4 min. For Group TI, the 
pre- and postwalking conditions were randomized 
but the walk lasted 8 min. The present concern is 
with only the 30-min. walk. 

The instructional set for the C-D pace was de- 
termined by the instructions “walk as though you 
were going from here to the theater (.5 mi.) and had 
just time enough to get there before the start of 
the feature without pushing yourself too hard." 
There was à s-min. rest between each condition. 
The session for each of the 3 testing days was 66 
min. for Ss in Group I and 86 min. for Ss in 


Group П. 


During the week р! 


k for all Ss on each of the 3 days of test- 
) two short walks starting from 
mph) or a slow walk (2 mph) 
ther decelerated or accelerated 
“comfortable-but-deter- 
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TABLE 1 


SUMMARY TABLE OF ANALYSIS OF VARIANCE OF THE 
First 15 Міх. VERSUS THE Last 15 Міх. 


AND GEORGE S. HARKER 


RESULTS AND DISCUSSION 
ы r rac 
In an effort to learn if Ss revealed а cha if 


id А А i z and 
or THE C-D Wark teristic pace during their 30-min. walk na 
this pace was stable over time, two analys 
Source | df MS | F variance were computed (Table 1). . effect 
GioupI | The analyses reveal that the xxm " 
Days (A) 2 2661 | 1.3989 conditions (first 15 min. versus last + stg 
Conditions (B) 1 1285 8718 of the 30-min. walk) were not significan E a 
vu (С) 8 ae маш” gesting that for each group the CD 
AX 2 0446 4! E F 5 
ASC 16 19017 171.5046+ 5 adopted was relatively stable. Le (ps 
BxC 8 | аата | 13.2793" effect was found to be highly signific e 
А айн S E | 927 8.3514* — 001) as was the Ss X Days interaction. | : 
I е 0ш findings reveal that Ss’ paces differ. em E 
Group II | other and suggest that though an 56р diffe 
pes (А) i 2 1.8976 4022 stable for any one day, his pace ree c 
Conditions (В)! 0205 0414 fr ау observat! th 
Subjects (C) 9 21.4918 820.2977 om. Wy Di day dup fact tha e 
AXB 2 2194 EE tribute to accounting for the x Cont 
AXC 18 47176 | 180061:* е Conditions x Ss and the por al ud 
A x 5 ХЕ ü 4954 18.0084* — tions X Ss interactions were statiste jon 
г С 2 27 " x т 
Within SH ps | 10.1870 nificant. No systematic day to day ween T4 
Total 809 mE Ss’ paces (such as a continual incre enced u 
В ж crease in pace) was observed as ёУ!С = л0 
*p <.001. the fact that neither the main-effec 
TABLE 2 
MEANS AND STANDARD DEVIATIONS FOR Eacu Sunjecr's 30-Mix. C-D WALK 
FOR Davs 1, 2, 3, AND AvERAGE ОЕ Davs 1-3 IN МРН ue _ 
M ЎА а?а 
Subject е З = , 13 
- — иа pays 
Day 1 Day 2 Day 3 | Days 1-3 Day 1 Day 2 Day 3 е 
Group I | 20 
1 2.72 240 245 52 15 
: к 242 3 12 ; 
2 3:17 317 3.00 311 T HE 069 4 
p P 2.65 2.95 2.88 .063 128 078 60 
4 3.03 3.83 3.46 3.44 ‘082 136 105 3 
Р 3.16 3.34 347 3.32 “089 ‘086 118 791 
: 2.96 2.15 2.33 2.48 120 178 491 E 
k "Es 3.00 2.88 3.07 ‘113 116 4128 131 
8 $52 3.35 3.20 3.36 ‘079 n 25 y 
5 Е 3.62 3.53 3 ; n ’ 
x зю Pec 63 070 075 22 j 
Group II 3.00 3.08 098 118 1 if 
1 3.94 " m 
5 "t 402 3.87 3.94 202 045 139 n? 
А 3.78 3.98 5 135 | 
3 Tel 5 3.85 069 114 > 17 
4 .83 2.84 3 176 8 
4 3.88 3.09 Ald 184 2 
3.79 3.91 7 219 942 
5 3.79 37 е 3.86 474 .083 х 237 
6 74 3.88 3.81 335 110 098 КСА 
5 2.83 2.9; 323 | "us é 138 n 
7 3.79 3 z: 3.01 173 135 i AT, 
à ue 87 3.79 3.82 185 100 230 10! 
; 2.23 3.06 2.62 i ; 115 P 
9 295 417 ee 6 270 275 173 50 
10 375 2.80 2.68 ps 21 1ш 138 3 
= Р . .08 “е 
X 3.49 342 3.58 3.50 E* p 156 


the D 
„е Jays X Conditi i i 
tists i itions interactio = 
ally Rufus: n were sta 
nane à i 
Шеш d to determine what relationships 
Of Pearson we the 3 days of testing, a series 
то ы i 
computed, product-moment correlations were 
The 
aver, 
—— Pa mph for the 30-min. walk was 
“eviations hm each S. Means and standard 
able 2 Т Ss in both groups are presented 
the 39 i. Justification for averaging across 
Е ondition taken from the observation that 
\ Чіа е main effect was not statistically 
Ore a he mean mph for an S is there- 


со 


mea: > 
| compute the his C-D pace and was used 
Table the correlations betw { 

2). ween days 

"specti 
on of ” 

ous E» Table 3 reveals that for both 
lia Days 2 pace was more reliable be- 
mi combina 3 than between any other 
e : ion (p < .01). The analyses 
the é 
m 


iS pers 
of t п indicate that performance in 
Xception = groups was comparable with 
42 mph E the average mph for Group 
Vea] er Be c. than Group II. An even 
tue by Hw i difference, however, is re- 
саруу ауз 1 ek that the correlation be- 

for c yond the d 3 for Group I was signifi- 

Nog e UD I th 05 level of significance, but 

е comparable correlation did 


en 
I appr. es 
L go Pecti oach significance (Table 3). 


lon T 
Daeg Perf of Figure 1 reveals that on Day 


ог 

Gr imd € was more variable as com- 

ip И x 3 for Group II but not 

Sus D Ich accounts for the lower 
ау 2 and Day 1 versus Day 3 


Day 


D Р 
M aay TABLE 3 
LATION 
S (X Атик or Sunyects’ C-D PACE 
E ї FOR 30 MIN.) FOR THE 
` С S Vestine Days 
Н m———— 
Vg, c = 
1 ka Day 2 Day 3 
Da —— 
ay 
Dari | 
т 52 61 67* 
D PTS 
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к 3 S з 
л = 2 
2 g 2 a 
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Fic. 1. Mean and standard deviation of 30-min. walk 
ior the 3 testing days. (Groups I and II) : 


correlations for Group II as compared to 
Group I. 

Because the correlations between Days 2 
and 3 were so large, .92 and .90, respectively. 
analyses of variance were computed for both 
groups using only Days 2 and 3 to insure 
that performance in Day 1 was not primarily 
responsible for the significant Days X Ss in- 
teraction obtained with the data for all 3 
days. It was found that the Days X Ss inter- 
action, with Day 1 omitted, was still signifi- 
cant for both groups (p < .001) even though 
the magnitude of the F ratio was reduced. 

The Ss’ performances on Days 2 and 3 are 
presented graphically in Figures 2 and 3 for 
Groups I and П, respectively. Visual inspec- 
tion of these eraphs indicates that the primary 
reason for the statistically significant differ- 
ences obtained between Days 2 and 3 is that 
variability of the C-D pace is so small. Thus 
with very low variability even small differ- 
ences between mean C-D pace levels on Days 
2 and 3 are found to be statistically signifi- 
cant. For the majority of Ss in both groups, 
the C-D pace on Day 2 was essentially the 
same as Day 2i 

These results reveal that even though Ss 
C-D pace on Day 2 may be significantly dif- 
ferent statistically from their C-D pace on 
Day 3 (the significant. Days X Ss interac- 
tion), the C-D pace on Day 2 is highly simi- 
lar to the C-D pace on Day 3 (the significant 
coefficients of correlation). 

The discrepancy between the two 5 groups 
relative to the correlation of C-D pace be- 
tween Days 1 and 3, combined with the ob- 
servation that the overall mean C-D pace for 
Group I was almost 5 mph lower than Group 
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GROUP I 
SUBJECT DAY 2 e DAY З orv " 
1 Ў "т 
2 
c 
2 s 
о 
I 4 
hr 
Q 5 
ш 6 
= 
= P 
8 
9 
MINUTES " 
Fic, 2. Mean mph/min for the 30-min. characteristic C-D walk on Days 2 and 3. (GrouP 
GROUP II 
с 
2 
[e] 
I 
a 
ш 
а. 
N 
ш 
= т terrm tt m" sd 
MINUTES i 
Fic, 3. Mean mph/min for the 30-min. Characteristic C-D walk on Days 2 and 3: (GrouP 
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П 
К. — that in measures of this type of 
desired oo large groups of Ss are to be 
Pics E is doubtful that the longer pre-C-D 
br pls for Group IT (8 min. for bath the 
Toup II 3 and the fast to C-D walk for 
the CK compared to 4 min. for each of 
the differe walks for Group I) account for 
tween the nce observed. One difference be- 
Noted js "ds groups of Ss that should be 
ext goin most of the Ss in Group I were 
none of a 2 paratrooper training whereas 
ls trainin s in Group II was scheduled for 
along wis The extent to which this factor 
rM rg factors (psychological and 
Served win 3 were related to differences ob- 
e tin E the subject of future research. 
termine ое in this line of research is to 
а fast Daca е effect of initiating a walk with 
Pace ( (5 mph) versus a slow starting 


‘ (2 mph) i 
а. wu in terms of the C-D pace Ss 
ay current. on observations made during 
nly 5 research, it is hypothesized that 


his боз are required after initiating а 

daily cha ast or slow, for an S to reach 

dS the h Tacteristic C-D pace. 

каче нын C that individuals have а 

at Оп any gi -D pace that is relatively 

tech be Pone er day was supported, it will 
a е to apply the relative loading 


Чу lque t " 
ity 0 this dynamic muscle group ac- 


a : 
Pes Mes various measures of endur- 
D ace a that of the various 
зубр tO imc or walking measures to be 
‘oun logica] ious physical, physiological, or 
C 9 be a easures available, two will be 
% ch: (o je most meaningful in future 

к: giv Ss’ variance of the C-D pace 


en day; and (Б) the variance of 
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Ss’ C-D pace from day to day (H 
ой), y (Holmgren, 
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Data gathered from 1,900 male wi 
United States are presented. Thes 
fluence of environmental character: 
irom middle-class norms. 
which should foster integr: 
jobs differently and would 
in communities fostering integration wi 
higher satisfaction on highly skilled job: 
should plan for it while working. Alienat 
faction on highly skilled jobs. Pay should 


istics р 
Predictions we! 


tion of alienated workers, and these workers w 


other work after retirement. The predic 


blue-collar workers. The implications of these fi 


models of human motivation are discussed 


Some recent industrial field studies have 
pointed up the importance of community vari- 
ables as determiners of workers’ responses. 
Katzell, Barrett, and Parker (1961) and 
Cureton and Katzell (1962) found job satis- 
faction and performance inversely related to 
the degree of urbanization of the community. 
They attribute this relationship to differences 
in needs and expectancies of the workers in 
the various environments. With increased 
urbanization, needs and expectancies rise and 
there is less satisfaction from any specific re- 
turn. Hulin (1966), using the worker’s frame 
of reference as an intervening variable, pre- 
dicted and empirically verified that job satis- 
faction is higher in communities with sub- 
stantial slum areas. The assumption of his 
discussion is that the worker assesses his 
present status by referring to the alternative 
positions which are available to him. Since 
attractive alternatives are not readily ap- 
parent in slum conditions, the worker's present 
job will be seen as relatively more satisfac- 
tory. Turner and Lawrence (1965), ina study 
of workers’ responses to the technological 
aspects of the work Situation, found that 
rural and small town workers were more satis- 
fied when their jobs were more autonomous, 
required more skill, were more varied, and 
contained more social interaction and re- 
sponsibility. In essence, the most satisfying 
jobs demanded greater personal involvement. 
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orkers located in 21 plants in the eastern 
е data are analyzed to determine the in- 


resumed to index feelings of alienation 
ге made that workers in communities 


ation with middle-class norms would structure their 
respond differently than alienated workers. Workers 


th middle-class norms should report 
з. They should value retirement and 
ed workers should report lower satis- 
have a stronger effect on the satisfac- 
ould be more likely to look for 
Were regarded as confirmed for 
ndings for striving need-theoretic 


tions 


Т 
Law rs 
explanations offered by Turner em о 
for this unexpected response pr ol wn 
is the notion of anomie, a sta rial д 


tion, which has been frequently inve 
in recent sociological researches. there ? 
In addition to these sudes p 
growing number of studies of E, r 
ment" which present conflicting 
general, results in line with Ds 
obtained if the studies are gem 
with rural backgrounds, but con 0 
are obtained if the workers are 
backgrounds (see Friedlander, 
nedy & O'Neill, 1958; Kilbridges 
From these studies and О a 
studies of anomie and alienatio? 


att 


Е - om 2, е 
аз а continuum running fea ена io й P 
with middle-class norms" to ^. it ho e 
middle-class norms." dad phen? „е af 
pointed out that this is a сотр aly for ond ie 
described as unidimensional o arated poa 
а At the integ yh? дт 
conceptualization. ‘ers V р 
the construct are found workC 7 jo 


" е 
Personal involvement with th 
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aspirati PES 
goals ee their occupations. Their 
climbing к уре of upward mobility, social 
Trid dae ae associated with the 
91 the construct, гаре At the apposite pole 
Mvolved in t y WOI kers can be described as 
that is, the ; E jobs only instrumentally; 
Pursuing Pieds only a provider of means for 
Í these work ccupational goals. The concern 
ility, high ers is not for increased responsi- 
Nan ШИ. Status, or more autonomy. They 
à minimal Y, and they want it in return for 
his кы. of personal involvement. 
ated Work nce between integrated and alien- 
discriminan is similar to Dalton’s (1947) 
ate likely int between overproducers who 
bs. mios middle-class aspirations and 
tio le-class i i: do not identify with 
di eing pro als. The construct of aliena- 
ч 5 relati posed in this study stands in 
Sed du to the Protestant ethic pro- 
ШР fing един Iy жаы ШШ. Р 
ы . d emi fostering integration 
Nee to the p will also foster ad- 
S ап aspect rotestant ethic since the 
to АГА! environ of the former. 
lenation f mental conditions should lead 
Suggested the middle-class norms? Data 
(Bar ass hig} at anomie is associated with 
I ur industrialized | situations 
› Dean, 1961; Killian & Grigg, 
Т Ж McClosky & Schaar, 
honi Turner "e 1964; Simpson & Miller, 
le is diffe & Lawrence, 1965). Though 
= ing Pi. conceptually from the con- 
le h ined here, the measurement of 


tag 
ду е Кз Such that it might just as 
ftom ° class E as alienation from the 
9 ee i e- |, is postulated that “alienation 
“here dli tion ass norms” results from lack 
ON E а to middle-class norms. That is, 
оц ‘day uc ent of society exists which holds 
н, ass norms and which is large 


tha, © SUstaj 
th, da 15{аїп і 
the ÂE sy n its own norms, the members 


ig, 10 cul ч К 
elus m o xm will become socialized to 
MU s worl at subculture. A handful of 
No, ee S in a small community 

Ya. Tms} ÉXpected У 
ed to sustain a separate set 


SE SOR 
ha eng, Persons separated from middle- 
Os low “жыш by low educational attain- 
ic Slums Upational status and living In 

S could and highly industrialized com- 

develop and sustain a distinct 
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norm system. Alienation from middle-class 
norms, then, is fostered by industrialized 9" 
cially heterogeneous, metropolitan conditor а 
This conceptualization of the background "ot 
the alienated worker coincides with the ae 
acterizations by Whyte (1955) of б етед 
and rate busters. The social and family Pea 
ground of restrictors was urban, working йвз, 
whereas rate busters were from farms м нн 
middle-class families. Worthy (1950) has iss 
pointed out the possible effects of living is 
urban areas on the motivation and especiali А 
the morale of industrial workers. à 


METHOD 


Before describing the methods of this investigation. 
two cautions must be invoked. First, though the 
data to be presented arc not such that they could 
support the contention of causality, a causal discus- 
sion is used here. A causal theory in this sense 
serves only as a working hypothesis to be altered 
as the data demand. This does not detract, how- 
from the usefulness of the construct as a 


esearch and application. Second, no value 
the use of the word 


ever, 
guide to r 
judgment is intended by 
“alienated.” It would be as logical to consider such 
workers integrated to their norms from which middle- 
class persons are alienated (and whether or not it 
would be better for the workers or for society for 


them to be integrated to middle-class norms is a 
er boundaries of this 


social question beyond the prop 

paper). Orientation to middle-class norms has been 
adopted as the point of reference here because mid- 
dle-class norms predominate in our culture. and 


among social scientists. 


Data for this study were 
carried out at Cornell University (Smith, Kendall, 


& Hulin, in press). Subjects (Ss) were 1,390 male 
blue-collar workers and 511 male white-collar work- 
ers representing 21 different plants located through- 
out the eastern half of the United States. These data 
were gathered in 1961 and 1962 as part of a large- 
scale study of retirement satisfaction sponsored by 


the Ford Foundation.* 


provided from а study 


Stimulus Variables 

the alienation construct it was 

necessary to have stimulus variables which indexed 

the environmental conditions which foster alienation 

and another set of variables which indicated the re- 

sponses of workers to their jobs. The variates used 
characteristics which should 


to index community 
foster alienation among the workers were chosen 
from a principal component analysis of an intercor- 


relation matrix of per capita census variables orig- 
inally provided by Kendall (1963). While the origi- 


1The authors would like to thank Patricia Cain 
Smith of Bowling Green University who very gener- 
ously made these data available for this analysis. 


To predict from 
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TABLE 1 


WORKER RESPONSE VARIABLES AND THE Conpition 


UNDER WHICH THE VARIABLE IS PREDICTED 


TO BE HIGHER 


Variable | Alienated 


Integrated 


1. Importance of planning | 
for retirement | 
2. Made plans yet for re- | 
tirement 
3. Preparation for retirement 
index 
+. Look for other work after | 
retirement | х 
5. Personal satisfaction from 
the job 
6. JDI work satisfaction- 
Skill correlation 
7. JDI work satisfaction- 
Job-level correlation 
8. JDI work satisfaction- 
JIG correlation 
9. JDI pay satisfaction-JIG 
correlation x 
10. JDI promotion satisfac- 
tion-JIG correlation 
11. JDI work satisfaction- 
LIG correlation 
12. JDI pay satisfaction-LIG | 
correlation 
13. JDI promotion satisfac- 
tion-LIG correlation 
14. JIG-LIG correlation 


| х 


nal solution was simply a set of Statistical variates 
which could be used to describe communities, 

eral of these dimensions appear to be useful as in- 
dexes of alienation. These variates consisted of the 


Variables, See Kendall (1963) for a complete descrip- 


tion of this solution. 


the Sum of Percentage of rural 
scoring), percentage of urban populati 


3 Urbanization indexed mainly by 


ulation, and Рег capita motor vehicle deaths (re- 
versed scoring); Urban Growth indexed mainly by 


vacant (reversed scoring), and Percentage of 


new 


homes; Prosperity and Cost of Living indexed by the 
sum of percentage of sound housing, medium income, 
percentage of workers in wholesale, per capita re- 
tail sales, and percentage with income Over $10,000; 


and Productive Farming indexed by the sum of pe 
centage of workers in wholesale (reversed scorn 
average farm income, percentage of workers io 
culture, and percentage of change in farm levi Ш- 
living. A sixth variable Population Density (рор' 
tion per Square mile) was chosen as а final ind® 
alienating conditions. 

There were no data indicating that these V A 
behave in the manner predicted. Thus, contr 
of the predictions of this report would serve 2°" . 


ariates 
tion 


А ondi- 
enlarge existing knowledge of the community at one 
tions fostering alienation. It was possible 007 


ог more of the variates would prove to be po 
index for the present purpose, and it уаз in the 
Certain that these six indexes would differ condi- 
strength with which they gauge the postulated jn the 
tions. For this reason, all of them were used some 
Position of the independent variable. Even ! ip 0 
of them did not show the anticipated relations m és 
showed it only weakly, the consideration 0! ing 
of them together Provided more understan m & 
the construct (cf. Webb, Campbell, Schw? 
Sechrest, 1966). 


Response Variables 


А ге 

Fourteen variables were chosen which T and 
pected to show differences between integra tit? 
alienated workers. Four of them concernet ce a 
ment. Workers were asked to rate the impor ey IP 
Planning for retirement, whether or not ther 0 
made plans yet for retirement, and whet ed. Ab 
would look for other work after they reU ish? 
a Preparation for Retirement Index was Гер atio 
for each worker indicating the extent of pre arsi 2 
the worker had made for his retirement 2 tite 
the three planning-and-preparation-for" work 
variables it was predicted that the integra t the ү 
ers would score higher since it was felt me ; y 
Sire for a leisurely retirement. has become алс d 
With a great deal of prestige or status sign eg 
the middle class. For the same reason, і пу 0 
Workers were expected to be less likely te emen L 
they would look for other work after n well r 

Workers were asked to rank their Шек of Pod 
their family life, hobbies, etc., as a prov! е ex egi 
sonal satisfaction. Integrated workers We" second 
to be more likely to rank their job first 01 [d 
а provider of personal satisfaction. Ы f the 100) 

It was predicted that the correlation n dex (7 
satisfaction scale of the Job Description ae alie" 
With a rating of job level would be lower Я alitis 
Workers than for integrated workers SIDES. аг the 
workers are more satisfied when their wd fof ind 
demanding. The same prediction was m ^ 
correlation of the JDI work satisfactio " 
ratings of job-skill requirements. ore сет of 

As the job was expected to play а wae the е 
role in the lives of the integrated works in 80776) 
relation between satisfaction with the jO eral @ 1б 
(TIG) and satisfaction with life in gene“ nd 
Was predicted to be higher for them. Faces “wil 
Were measured by General Motors | acti 
(Kunin, 1955). Using JDI scales, satis 
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t2 
Rn 
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TABLE 2 


PREDICTION TESTS USING ALL WORKERS: CORRELATIONS (PEARSON r's) 
BETWEEN STIMULUS AND RESPONSE VARIABLES 


Stimulus variables 
Response vari Predicted | | | 
ве variables RR | | Produc- 
direction ae. | Urban- | Urban | Cost of tive Popula- 
tons | ization | Growth | Living | Farming iE И 
1 | | (reversed) ensity 
"porta; | | 
Ma ase Planning for retirement) — | —-09 | —46 +31 | —42 | —16 | —51 
аиа: Yet for retirement - —18 | —40 | +24 | —57 | -20 | —.61 
К E MM retirement index | - EM -33 +15 | -28 | —-001 | —41l 
сопа] ЗЕ ЫП Work after retirement | + +.35 +.11 +21 | +.18 —.36 425 
elatis, action from the job — +.50 +16 | +43 +.19 —.15 00 
Ork sap; p Ween: 
Work sa, Sfaction-Skil] level = oo | 03 | -07 | —05 | +07 | +06 
Work оаа оп, Job level а -25 | —23 | —M | —19 | —24 | аз 
Satisfa, 'Slaction-Job-in-general 
"y satisfac = 426 | +31 | —44 | +33 | +32 | +38 
“Atisfaction-Job-{ 
satisfan on Job-in-general 
Pro op on gener: " =i —02 = 06 +.04 +.19 4.09 
К Sta Satisfaction-Job-in- 
Work ati Sfaction = Bl Enc RE. — 19 +18 | —.04 
‘Satisfaction Tite: | 
Sat; А lon-Life-in-g 
Pay айо Пешене] + | par | 08 | +30 | +2 | +34 
Atisfaction.1 sr, < = d 
Sat ‘Cllon-Life-in- | 
Promo ection ife-in-general М E 00 E —01 4.28 +28 
бг ыб ы | 
Een, atisfaction- Life; 
Шы Satisfaction. Liga: = 00 —05 | —20 —.13 +.28 +.04 
ing nera] satisf. * te. 
Benera: P Hs е _ +48 +14 —.11 +.07 +.19 +.02 
Note | | | 
Же, : ae 
Vor. "ENG Companies, Bold-faced numbers are in the direction of the prediction. 
hoy d sati 3 А x e 
in Uld y, Stisfacti А " iti mined by differences in the stimulus condition. 
in the be more ner with promotional opportunities us Шей dun reasons x D acu wl. be ШУ 
Hist integrated ЕУ correlated with JIG and E: arded as being supported if the finding was in the 
i ang” Should bene On the Uther 1 ait Lo ect direction and the results will be discussed 
Te Lig ; e more highly correlated Wi b А 
t 1 more MENY j] t specific findings. 
tivity Persons» the alienated sample because these as a whole and not as sp 
е У Which i ho view their job as primarily an RESULTS 
Мец peal 5 instrumental to Ње achievement 0 
qt x able T p; of these prediction са be Using all of the workers of the sample, the 
lee П ег jables аге 2 
пе ation p "x is d Mun Da “heading of Correlations were computed and the results m 
It ted to pẹ Which the level of the variable was be seen in Table 2. The first column gives 
бш 3 бе higher. predicted direction of the correlations for each 
Каф ear to assign each of the 21 plant оуу, Of the 84 predictions represented in this 
NON © on each of the indexes of alienating table, 45 are in the predicted direction. This, 
ae thee: On each of the indexes of workers’ tabte, ү the construct. 
з se qo alysis was carried out by correlat- of course, does not support с — 
АШ qd Я Sets of variables—the alienation іп- It scarcely seemed appropriate to ab ^ 
ind E or Ponse variables. It should be noted the construct after such limited analysis, an! 
mite 1900, Tees of these correlations was 21 a further step was proposed. It was assume 
NU tud the PAN of оше means that this e dud песн Pieals were much more 
р е numi Í subjects, was а V а $ 
б, bein cn onsidering ihe св ОГ ааз which ]ikely to be found among white-collar мее 
б, are Carried out, Further, 54 of the predic- than among blue-collar workers, regardless 0 


ta elage Dredicr 2 
ht tion, dictions about the relative size of а 


ifferences were being predicted in the 
Cween two response variables as de- 


t. If that assumption 


community environmen 
t have been masked 


is correct, the results migh 
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PREDICTION Tests Usixc BLUE- 
BETWEEN STIMULUS AND RESPONSE VARIABLES 


TABLE 3 


COLLAR WORKERS: CORRELATIONS (PEARSON r’s) 


ee 
| | Stimulus variables 
[Predicted] ——— ! | Ж | т Produc- | popula- 
Response variables | direction | Slum | i i 
S " Е ^ с tion 
Condi- | Urban- U rban оз, ah cdd Density 
toda ation | Growth Living reversed) 
| | | 35 
Importance of planning for retirement = +23 | —22 +.42 —.18 = 09 65 
Made plans yet for retirement - —.25 55 +.09 —.57 —.05 EV] 
Preparation for retirement index = —.46 | —.19 = | 620 +20 +% 
Look for other work after retirement | + +32 | n +.02 | +16 —.22 n 
Personal satisfaction from the job = +52 | tió 4-46 439 | = i 
Correlations between : 3 ы | 07 
Work satisfaction-Skill level -— = | чот] ылу] 2x9 | e| +0 
Work satisfaction-Job level | = | —.65 =I | a 47 Ке 20 +17 E 
Work satisfaction~Job-in-general | | ` : T +25 
satisfaction = =i 2t = 7 37 а 
Рау satisfaction-Tol.in-cenera] i == s us F E 12 
satisfaction П | Si 
a + +1: Д 09 
Promotion satisfaction-Tol in. | 18 | +02 шы ши * 17 
general satisfaction 2 ms 
Е B ^ = =i | —2 = - —.02 
Work. satisfaction- Life-in-genera] | | | n " xi ГА 13 
satisfaction | iem | —31 | 445 — 48 05 +47 
Рау satisfaction-Life-in-general | Ж. s Y 4.28 
satisfaction | s | 4.37 » 
Promotion Satisfaction-Life.in. + | ш | dels | 09 | ыш i 06 
general satisfaction == — | | | " -.26 T 
Job-in-general satisfaction-Life- ag [ = c "afa T 21 
in-general satisfaction | 1 00 йз 
| = à | -01 | na 
Note—N = 21 companies, m 
wW 
by the j i i : p^ 
rd nclusion of white-collar Workers іп global Satisfaction is too strong t° 1 dif 
е sample, Accordingly, the 511 white-co]] e EN ironment? ре 
work y, white-collar modification Ьу the social environn Th 
orkers were dropped, and the anal E v atis 
redone, Again sharin ar a ‘alyses were — ferences which are being measured al sat 
Шел is т a € direction of predic- other nonconfirming variable, Person? ^ op- 
St column, the results using only I 


; section ^ 
faction from the job," is in the direct op 


: ч - ix 
еге 61 of 84 red hown in Table 3. Posite the Prediction in five of the pu^ 50 
direction Using the ee page the proper Portunities. The present analysis 15 cluded 
to the binomial dist ibus. (20Р7охітабоп power ful that this response can be СО pat’ 
of finding this € EE bod Probability (o act in this direction in all cases. ace 
predictions у a Confirmations Out of  ticular response and related areas Sh? cov" 
Though extreme ксы > "à D UU tainly enjoy increased interest in ? Р 
: € used in at. tinuati is li an 
aid muti pet the results of an "Ts ү. m ен Livin в 
©, three of the res on E onditions, Cos гейс | 

ables warrant Pease Vers Than teri ot best as P™ pd 
which did уве Those аге the three of alienated а vu 12,1 ration 
work-]IG Mises = construct. JDI correct Predictions respectively Urban! тей 
У ‚ an work-LIG and Р, ; Y ^ud 1 ac 

B ad 10 € y 

correlation do not Present any clear Pattern, predi ара Density each к Т Шу 
Тһе equivocal results With these two correla- oj b - while Productive ii s ош st 
tions are not easily explained Perhaps the Yes the Sl; hus, empirically as we dee d : 

lationship between work Satisfaction and um Conditions variate is nst" 


А H (uU 
closely aligned with the alienation C 


| 
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j The Producti x 
ctive Farmi 2 
sem useful, e Farming variate does not 


DISCUSSION 


In ge А 

Enni pus that the construct of 
ST Structurin een demonstrated to be useful 
“town that 8 workers’ responses. It has been 
Which mang e living in communities 
5$ norms oster alienation from middle- 
Ves mdr oo their jobs and their 
mmunities r differently from workers in 
"mS would where adherence to middle-class 
Stences we һе expected. Further, these dif- 
à rs predicted from a theoretical 
: ee with the construct of 
the ilot study ce study should be regarded 
rath Problems ai d is discussion will emphasize 
°С than the н future research direction 

os ls true кейде pene of the findings. 
i research « т this study as in the previ- 
[OM ” ls not саваа from middle-class 
based et al. As only tenable hypothesis. 
mw 0 lee ns invoked an explanation 
ang And neat” needs” being generated by 
“tam endal] To aee Hulin (1966) 
apt Of ref 63) used the concepts of 
Pres Able to t erence" and the "alternatives 
ang Sed an А: Workers" in economically de- 
Ыыы түр communities. Turner 
Mie” to "i (б) used the concept of 
Study А ain their results. Even in the 
NEN О-те егер is possible that an economic- 
hy ndin ce hypothesis would be useful 
tiong e made the results. The cost of liv- 
they, üBgesti € 11 out of 14 correct predic- 
a Orker, у 8 that fr f reference of 

tp Pers in th ames of reference 
UM ole in Ж е community play а signifi- 
lii han c tucturing workers’ jobs. On the 
nat оцу, раа with а high cost of 
tom 4 Place € expected to be less than Op- 
Mig Ше Scd Workers to live. Alienation 
е а rea of the dominant social group 
iS м M тш; response of the eco- 
iy 06 the ce Vantaged workers who might 
ne Ше: rie as the cause of 
lo tivg 3 may position. Thus, both of these 
fee g farmin Бе similar. Also, since "pro- 
М t j B Proved useful in predicting 
тена Action consistent with а 
Ue 1963) t explanation (Hulin, 1966; 
^g j but not alienated responses 
Structure, the economic-frame- 
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oe E in the present study 
п us. It also could be argued that 
anomie remains a tenable explanation for 
these findings and all that has been found is 
that integrated" workers are more predict- 
pesi n alienated” workers who are truly 
the ds na te = indicates that in 

y of the cases prediction has been 
made for stronger relationships between re- 
sponse variables for the integrated sample 
However, of the 18 cases where higher rela- 
tionships were predicted for the alienated 
workers, 17 were in the expected direction. 
Thus, it does not appear that anomie is a 
tenable explanation. The alienated workers 
are not normless. They have norms but they 
are different from those of the middle classes. 
It would appear that “alienation from 
middle-class norms” is the only construct so 
far invoked which is capable of structuring 
all of these diverse findings. 

The construct was not confirmed above 
the level of skilled plue-collar workers. The 
fact that it was not found in a sample of 
white-collar workers is in line with the defini- 
tion of the construct. The possibility that dif- 
ferent occupations may generate different sus- 
ceptibility to alienation is similar to Blauner’s 
(1964) reasoning and certainly has not been 
ruled out. While the upper boundary of blue- 
collar workers was arbitrarily set at the level 
of skilled workers in this study, future re- 
search may show that some other level will be 
optimal in applications of the construct. 

The present data delineate attitude changes 
which accompany alienation. Ап area of at 
least equal and probably greater importance 
will be to see if there are related behavioral 
changes. Related to job-performance differ- 
ences is the question of what job-design cri- 
teria will be most effective in maximizing 
satisfaction and performance among alienated 
workers. As the Turner and Lawrence (1965) 
findings suggest; the best job design in alienat- 
ing conditions may be contrary to the models 
usually proposed by human-relations-oriented 
investigators. Although integrated workers de- 
sire greater responsibility and autonomy, 
alienated workers may be happiest when given 
a job which demands little personal involve- 
ment either in terms of task skills or identifica- 


tion with the goals of management. 
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It should be reiterated that this represents 
a pilot study and although ш, те- 
garding all of the relationships were ша e B 
priori there is still only a rudimentary know! - 
edge of the effects of the independent varia- 
ble. Eventually, with increasing knowledge 
and sophistication one may know enough 
about alienation to attempt direct psychologi- 
cal assessment rather than indexing it by 
means of environmental variables. To the 
deplorers of “actuarial research" (such as has 
been conducted here) this would represent a 
significant step forward. However, if this di- 
rect assessment is carried out, researchers 
will be back in the domain of verbal response— 
verbal response correlations with all of the 
attendant problems of response sets, halo, 
acquiescence, and unreliability. Even with the 
“slippage” that occurs between an index and 
a construct, it seems preferable to use a stimu- 


lus-response paradigm as was employed in 
this study. 


This study does seem to have strong im- 


Plications for theorists who would like to 
talk about “basic human needs,” Both the 
currently popular need hierarchy approach 
and the human relations theorists talk about 


needs for self-actualization, needs for au- 
tonomy, needs for а 


demanding job, ete 

Which are supposedly basic needs of all people. 

These data indicate that at the very least 

these systems need to be revised to take cul- 
tural differences into account. 
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ETERMINANTS OF WORK ATTITUDES AMONG NEGROES' 


ROBERT BLOOM ахр 


JOHN К. BARRY? 


University о] Florida 


The motivator-hygiene theory of work 


attitudes assumes that 2 independent 


E i нөр А 
ets of variables determine job satisfaction and job dissatisfaction. The gen- 


erality of this theory was tested with 


responses from 85 Negro blue-collar 


work А й 5 

m to a 40-item questionnaire. These data were factor analyzed and com- 

va with comparable data from 117 white blue-collar workers. The 2 sets of 
ata appeared to differ although some similarities were found. It appeared that 


hygiene factors were more important to tl 


he Negroes than to the whites. The 2- 


f ә 

yi theory may be too simple to encompass the concepts of job satisfaction 

th Issatisfaction, at least in the blue-collar Negro. It may be that the 2-factor 
cory is less useful when one considers low-status work. 


Most 
Motivator. 4 the research on the two-factor 
«n Ph i dna theory (Herzberg, Maus- 
it vole 1959) has involved white- 
es » testin rs. Friedlander (1963, 1964, 
cbloyeo. § engineering supervisors, salaried 
„а ap епз, and several other oc- 
i inf oup With a variety of question- 
in Wation ш concluded that, although 
àv! satista E factors are important 
"lici t independe. and dissatisfaction, they 
dig d from ent as would have been pre- 

“Ussin, erzberg’s theory. Ewen (1964), 


Sta. 8 t 5 
tes; he motivator-hygiene theory, 


те Extensi 
bre a ns research design is necessary in 
dite Sent, Dd test the Herzberg theory. For 
to i OF satina О it must be concluded that the 
* dig act exist) 5 and dissatisfiers (if such variables 
Tent į di is as yet far from clear, and may 
ifferent jobs [p. 1631. 


(1966), studying accountants 
"eon терора (as did Herzberg et al.), 
Dice ite €s to both forced-choice and 
Satisfying 10 describe past satisfying 
"s job situations. He concluded 
'vator and hygiene factors con- 

у 39у axtisfaction and dissatisfaction. 
Ti, — and Barry (1965) designed a 40- 


& 
a 
t еар as А 
Aq? D-112 supported in part by a re- 
"minise. 127, from the Vocational Rehabili- 
q гат s Department of Health, Edu- 
9 thank Washington, D. C. The authors 
for hel M. R. Malinovsky and С. Н. 
1 D in data collection and analysis, 


е Reg 
ore Rehabilitation Research In- 
ealth Related Professions. 
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item Work Attitude Survey (WAS) to meas- 
ure work attitudes of blue-collar workers. The 
WAS consisted of 20 motivator and 20 hy- 
giene items which were rated on a Likert- 
type 5-point scale. There were 4 items repre- 
senting each one of the 10 work-attitude 
variables taken from the motivator-hygiene 
theory of job satisfaction. The sample con- 
sisted of 117 white blue-collar workers em- 
ployed in the grounds crew (primarily mainte- 
nance men and watchmen) in a large Southern 
state university. 

Malinovsky and Barry obtained 12 factors 
which are listed in Table 1. For the most part, 
these factors were composed of either mo- 
tivator or hygiene items. A second-order fac- 
tor analysis yielded two general factors, which 
roughly corresponded to the motivator and 
the hygiene sets of variables. However, the 
authors noted that these two sets of work- 
attitude variables were “of as completely in- 
dependent of each other in this study as might 
be predicted from Herzberg's theory. 

The present study was designed to deter- 
mine whether work attitudes of Negro blue- 
collar workers could be explained by Herz- 
berg's two-factor theory. Also, a comparison 
with the Malinovsky-Barry data from white 
blue-collar workers was planned. 


METHOD 


hich had been designed to study 
the work attitudes of white blue-collar workers by 
Malinovsky and Barry (1965) was used in this 
present study. The WAS was distributed to 180 
Negro, male, blue-collar workers in June 1964, at 
the same time that it was distributed to the white 


The WAS form wh 


ТАВГЕ 1 


LISTING OF Factors AND COMMON ITEMS 
IN THE 2 STUDIES 


Bloom-Barry study Malinovsky-Barry study 


Factor name At Factor name As | Bb 


1. Work Situation | 5 
П. External Guid- 


u 


IX. Work Frustrations 
VII. Physical Work 
7 Environment 


complishments 
VI. Work Role Dis- 
satisfactions 
X. No Interpretation’ 
- No Interpretation] 
- No Interpretation 


tion 

X. No Interpreta- 
tion 

XI. No Interpreta- 
tion 

XII. Peer Relations 


ХПІ. Work Frustra- 
tion 


oT Ss 
ance У 
- II. Physical Work 
e ш M Environment |9|3 
IV. Salary I. Salary 412 
У. Advancement IV. Advancement 3|2 
VI. External Encour- VIII. Unrecognized 
agement Work Ейогїз 3|2 
VII. Work Satis- II. Technical Super- | 
factions vision X |е 
УШ. Supervisory Re- ПІ. Interpersonal 
lations Relations 2 | — 
IX. No Interpreta- V. Individual Ac- $ 
2 
2 
2 
3 


ы шю шю ш и n Gua 


* A = Total number of items loading over .40, 
УВ = Number of common items in same factor in the 2 
studies. 


* Factors not considered comparable. 


blue-collar workers in the Mali 
Eighty-five questionnaires ( 
43% from the white Workers group) were completed 
and returned anonymously by the Negroes. These 
85 Negro workers comprised the sample in the 
present study. АП 180 workers were employed by 
the Plants and Grounds Department in a large 
Southern state university. Of the 85 returnees, ap- 
proximately 50% were employed as janitors and the 
rest in various other unskilled and semiskilled jobs, 
In the white sample, less than 5% were employed 
as janitors and the majority of the rest in mainte- 
nance positions at all skill levels, 

The age of the N 
63 yr. with a me 


novsky-Barry study. 
4796 as compared to 


egro workers ranged from 18 to 
ап age of 43 yr. The mean age in the 


$3,000 with a г 


rotated. 


Rosert Broom AnD JoHN R. Barry 


RESULTS 


The 13 factors which were extracted from 
the rotated factor matrix are listed in Table 1. 
All items with loadings of .40 or above were 
considered as contributing to that factor. of 
the 13 factors extracted, 8 factors contained 
both motivator and hygiene items while 2 
(Factors IT and IX) contained only hygiene 
items, and 3 (Factors X, XI, and XIII) con- 
tained only motivator items. In general, the 
hygiene items had higher loadings and de- 
termined more of the variance in the factor 
matrix than the motivator items. 

Factor I—The Work Situation—appeared 
to reflect specific feelings toward many aspect 
of the work context. This factor accounted 
for approximately 10% of the common vati- 
ance. Subsequent factors, IT, ПІ... XII, a 
counted for decreasing amounts of the 
ance, Factor ХІПІ accounting for only abou 
5% of the variance. Factor II—Esxterm? 
Guidance—was composed of items suggesting 
that the worker felt that his job environmen 
was controlled by supervisors and other com- 
pany decisions. Factor III—External Ince? 
tive—reflected the workers’ concern with thé 
job content, rather than the interpersonal ele- 
ment. Some of the items contributing to e 
factor suggested that the type of equipmen 
used by the worker was important to him А 
an indication of Status, 

Factor IV was determined by Salary items 
and Factor V was concerned with worker А 2 
vancement. Factor VI- External Encourage” 
ment—reflected the importance of encourage” 
ment and recognition by supervisors. e 
VII—Work Satisfactions— reflected жени 
pride and satisfaction in the intrinsic aspec 
of the work itself. Factor VIII— Supervisor 
Relations—reflected the importance of Pb 
sonal relations with those їп a higher J 
Status. Factor IX, X, and XI appeared tp ns 
uninterpretable. Factor XII— Peer Re 
—teflected the importance of peer relation 
in the work context, Factor кшп. 
Frustration—suggested the need of the wor 
to feel responsible and independent. m- 

A comparison of the factors and the ОГ 
ber of items common to each factor 10 "my 
Study and that of Malinovsky and dd 


ыч 
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(1965) is shown in Table 1. Substantial dif- 
ferences as well as some similarities are evi- 
dent in the two studies. The two sets of data 
are comparable in that Factors I, II, III, IV, 
Po VI in the present study are roughly 
ee Factors IX, VII, I, IV, and УШ, 
epg in the Malinovsky and Barry 
E Y. On the other hand, the fact that most 
the factors in the present study contained 
n motivator and hygiene items suggests 
E the Herzberg two-factor theory is not 
Well substantiated as in the Malinovsky- 
солу Study. Furthermore, the present find- 
8s show a far more complicated picture of 
fron E motivations of the Negro than 
ave been predicted from that theory. 


DISCUSSION 


a he implications of this study regarding 
аге so Itudes of the Negro blue-collar worker 
the wae attenuated in that only 47% of 
Were n Ss were returned, and a few of those 
might E» completely filled out. А question also 
Ке raised as to whether the Negroes 
Way а €d the items on the WAS in the same 
Since de whites did. Probably they did not, 
Studies € item overlap in the factors from the 
"rom e relatively small (see Table 1). 
e is disparity in perception, and from 
Content of the items in the factors, it can 
gamed that, if in fact, motivator and 
of refer variables do exist in the Negro frame 
оган ps hygiene variables are = a 
Variables” the Negro than are motiva 


ang @dlander (1966), testing both white- 
blue. Че-соПаг workers, found that for the 
"ац Mlay worker there were no significant 
°nships between any of the motivational 


Cas : 
lang, TS used and job performance. Fried- 


import further described a hierarchy of factors 
facto, Dt to the blue-collar worker with his 
the i ocial Environment of Work, heading 
Worp ^^ For the blue-collar group “the pre- 
M Stem Uture evidently forms а motivational 
3 pr Which remains intact throughout, and 
nt [E ly reinforced by, the work environ- 
Usin, dander, 1966, p. 151]? 
Prestig Hatt and North’s (1962) lists of 
tion «86 Ratings of Occupations, the occupa- 
janitor was found to be rated lower 


than that of carpenter, machine operator, 
plumber, etc. The lower job prestige and the 
lower mean salary of the Negro workers, when 
considered in relation to other cultural differ- 
ences between the white and Negro groups, 
are consistent with the suggestion from this 
study that hygiene factors are more im- 
portant to the Negro. For as Herzberg et al. 
(1959) pointed out, hygiene needs must be 
met before motivator needs become operative. 
Perhaps these data represent a stage in the 
maturation process of a working subclass. 

Parker and Kleiner (1966) have described 
and documented the failure of Negroes to 
share in the American Dream. While exposed 
to many of the same stimuli as whites, Negroes 
often find the pathways to achievement 
blocked. Data in the present study suggest a 
difference in the perceptions and goal struc- 
tures of white and Negro workers. The present 
study does not imply cause nor effect. The at- 
titudinal differences found in this study may 
both cause and result from cultural factors, 
and certainly will limit how these men and 
their families perceive their futures. 

Friedlander (1966) generalized that the 
cultural disparity between white- and blue- 
collar workers was sufficiently great that “gen- 
eralization concerning the motivation-perform- 
ance relationship cannot be made from one 
cultural group to the other [p. 151]." Thus 
the farther one departs from the higher 
status occupations, the less adequately Herz- 
berg's theory appears to represent the true 
attitudinal mechanisms. 

Certainly a great deal of further research 
is needed to understand the motivations of 
the blue-collar worker in general and the 
Negro blue-collar worker in particular. To 
date, the diversity of research methods, tech- 
niques, and samples probably has been great 
enough to account for the diverse findings. 
Whereas subcultural differences undoubtedly 
affect perception and attitudes, the definitive 
study relating these differences to work at- 
titudes has yet to be made. 
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THE GRAPHOANALYTIC APPROACH TO SELECTING 
LIFE INSURANCE SALESMEN 


S. M. ZDEP anp Н. B. WEAVER? 


University of Hawaii 


Using handwriting samples from 63 life insurance salesmen, an attempt was 
made to select both successful and unsuccessful salesmen through use of Grapho- 
analysis. The criterion was based upon Ist-policy-year commissions adjusted for 
years of experience for each salesman. It was not possible to select successful 
salesmen by analyzing the writing for 13 personality traits selected intuitively 
by the analysts, nor was it possible to do this using dominant traits “dis- 
covered” in the handwriting of successful salesmen. However, it appears that it 
may be possible to select failures on the basis of “lacking” certain traits as 
determined by their handwriting. It is recommended that this aspect be in- 


vestigated in future validity studies. 


oe the past several years there has 
Writin creasing interest in the use of hand- 
85 analysis both as a diagnostic and 
Testa ешш technique. A summary of 
Pluck, in this area is provided by 
iger, Tripp, and Weinberg (1961). 
sin and Kernan (1962) reported 
a Sful results using handwriting analysis 
ct supervisors in an industrial situa- 
hey also pointed out the extensive 
handwriting analysis in European 
of employees, especially in West 
Enon Lewinson (1961) stated that the 
ls рте ап acceptance of handwriting analysis 
th i ag than in the United States and 
, 15 taught in many universities. More- 
iz qo professional handwriting-analysis organ- 
Чопа] , CMISt within the framework of na- 
Py nce. S chological associations in Holland, 
ч Switzerland, Germany, and Austria. 
tity a € United States, the prevailing at- 
in ipa ad the use of handwriting analysis 
When ЧУ was expressed by Bellows (1961) 
арр са Stated that a final decision on its 
incon ОШМУ was not vet possible due to the 
Pleteness of available evidence. 
With * Present investigation was undertaken 
‘Viden © hope of providing some of this 
ha, 7C. Since the analysis of handwriting 
Dun, SIOWh to the point where there are 


его 5 ; 
is ed Systems and theories, it was de- 


Thi 
other $ ар is based upon a thesis by the first 
fy Ha di mitted to the Graduate School, University 
© the Ub in partial fulfillment of the requirements 
“Ster’s degree. 


Suc 


Selection 


cided to use a standardized method, Grapho- 
analysis? In a previous investigation using 
this method, Galbraith and Wilson (1964) 
demonstrated that interrater reliabilities 
ranged from unacceptably low (7 = .61) to 
quite high (7 = .87). Validity data were 
not reported. 


METHOD 


Subjects 


The Ss in this study consisted of 63 life in- 
surance salesmen from three life insurance com- 
panies in Honolulu. All but 4 of these 63 had 
been selling life insurance for at least 1 yr. and 
all were fulltime salesmen. The remaining 4 left 
the life insurance business aíter periods ranging 
from 2 to 12 mo. 


Procedure 


All salesmen were instructed to copy the follow- 
ing paragraph in their normal handwriting style: 


What are the various stages in the collection 
process? We may define the stages as early, 
middle, and late. In the early stages, we can 
assume that the debtor will pay if we merely call 
the obligation to his attention. We do not send 
a letter—just a statement with an enclosed en- 
velope. Later we may send a second statement 
as a reminder. Then if no response follows, 
we send a letter of inquiry to find out why the 
debtor is delaying payment. ЇЇ we receive a 


2Graphoanalysis is a copyrighted method of 
handwriting analysis by the International Grapho- 
analytic Society, Chicago, Illinois. Two certified 
Graphoanalysts, Doris Williamson and Dorothy Gal- 
braith, performed the analyses on the handwriting 
samples in this study. Their cooperation is grate- 
fully acknowledged. 
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reasonable explanation, we need send no further 
letters. 


In the opinion of the two Graphoanalysts ез 
served as judges, this paragraph provided а sufi- 
cient number of "strokes" to permit pee cmm 
on selected personality traits. The fota number o 
times that a given trait could “appear” in the 
test paragraph was tabulated. The 5s then re- 
ceived a numerical score for each trait on „the 
following basis: (1) does not appear, (2) slight 
number of appearances, (3) moderate number of 
appearances, and (4) appears consistently. Scores 
were assigned according to the following formula: 


Number of judged appearances 


X = Total number of appearances possible 


The experiment was divided into three parts. 
Two different approaches were tried at predicting 
successful salesmen, and a third attempt was 
made at selecting failures. 

The criterion measure of job success was based 
upon initial year commissions on life insurance 
policies sold during the calendar year 1964 (first- 
policy-year commissions). These earnings were 
converted to a score based upon years of experience 
in selling life insurance. This was derived by having 
all three companies submit data indicating the 
amount each of their salesmen earned in first- 
policy-year commissions in recent years, based on 
years of experience for each man. These data were 
for all salesmen employed by the companies in 
the State of Hawaii, not merely Ss used in this 
study. Once this information was tabulated, a 
consultation with the companies yielded criterion 
measures based upon Table 1. 


Part I 


The Graphoanalysts attempted to select success- 
ful salesmen on the basis of 13 traits (see Figure 1) 
which they felt were necessary in the sales profession. 
A score referred to as a correction factor was as- 
signed for miscellaneous undesirable traits that 
appeared in the writing. This score, ranging from 0 


through 3, was subtracted from the grand total 
for the 13 traits. 


E prior to 

Handwriting samples were coded by ape 

their being given to one of the analys е ЫК, 
completion oí the ratings, they were return 


for 
recoded, then given to the second analyst 
rating. 


Part II 


In a second attempt, the handwriting ge 
of the three most outstanding кир, they 
analyzed to determine the dominant Я the 
judged to be present. (They were not given 
results of the first analysis, nor were EA ex- 
any indication that anything else would hand- 
pected of them. The analysts never saw R being 
writing sample a second time without a wit 
recoded. Periodically, samples from salesmen a 
unavailable criterion scores were шере she 
buffer items) Each analyst picked out ыл сот- 
felt were dominant traits in the writing. ihe fol- 
parison of their ratings indicated that husiastt, 
lowing traits appeared consistently: dis dedness 
like of variety, self-castigation, broad-min 
vanity, and independence. lyzed for 

The remaining samples were then auris dis- 
these traits on the assumption that ШО уві 
playing them would be successful. The x 
Working together, gave each salesman a Seng 
(trait does not appear) to 5 (outstan 
trait) for each of the above traits. 


Part. III 


The third approach consisted of attemp 
select failures. The handwriting samples of 
salesmen who had quit were analyze uacies 
analysts in order to discover any jp in- 
they felt were present. The handwriting 5170 dence 
dicated that these four lacked зау-сопђи 
tenacity, independence, and were low in de 
change and variety. А 

For this attempt the criterion was redefine’, 3 
calling Criterion Scores 1 and 2 “apt to criterio? 
was the borderline point, and 4 aed rom the 
Scores represented “successful salesmen. ses, 
remaining handwriting samples, 23 succe: The 
failures, and 8 borderline cases were selected- 


t 
E our 
the 


deter 
analysts, working together, were asked tO 
TABLE 1 
CRITERION SCORES IN TERMS OF EARNINGS AND EXPERIENCE „== 
ET Criterion score 
experience 
p 1 2 3 4 : 
* 0+ 
1 Less than 2000 2000-3000 3000-4000 00 550 
2 Less than 3000 3000-4000 4000-5000 PEE on 
3 Less than 3750 3750-4750 4750-5750 5750-7000 | 00+ 
4 Less than 4500 4500-5500 5500-7000 7000-8000 0+ 
5+ Less than 4500 4500-5500 5500-7000 7000-8500 B5 


Note.— Earnings given include only first-policy-year commissions for individuals exclusively selling life insurance 


Ew 


афр 


Personality Trait 
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Illustrative Stroke 


Determination 
Diplomacy 

Purpose 

Persistence 

Initiative 

Attention to Detail 
Organizational Ability 
Analytical Ability 


Si 
ense of Responsibility 
Pride 


Enthusiasm 
Independence 
Desire for Variety 
Self-Castigation. 
Broadmindedness 
Vanity 

Self Confidence 


Tenacity 


Fic. 1. Traits and the 


оц h 
T traits named above. 
Wei 


ро м « 
re П completion of the ratings, 


Ww 
4 


te 


9 Ss 28 o u= 
& 


a salesman possessed or lacked each of the 


the samples 


them Ee Кеп from the analysts and returned to 
this la: Week later when they were asked to repeat 


St analysis, 

Part 7 
I 
сас 


RESULTS 


p ctiudge reliability of the analysts On 


Of the 13 traits was determined by a 


Cars, 
Values | product-moment 
were significant but ranged from un- 


Accept 


correlation. АП 


= зур? low (ғ = .50) to quite high (r 


TABLE 2 
INTERJUDGE RELIABILITY ON TRAITS 

р 
Diplop ation 50 | Analytical ability -70 
Rumo | 85 | Sense of responsibility .60 
Persiste 62 | Pride 50 
Тава zi 65 Enthusiasm 70 
Attention ‚58 | Independence 63 
Ойнак detail 763 | Desire for variety 76 
ong, tional ability .58 | Grand total 51 

ction factor 36 


Determined by 
Width or heaviness of downstroke 
Tapering off or slanting structures 
Heaviness and height of t-crossings 
Tied strokes in the form of a loop or knot 
Forward swinging stroke in a p, 8, j, ory 
Dot close to and directly above the letter stem 
Balanced loops above and below the writing line 
v-formations at the base line of writing 
Large initial loops on capital letters 
Height of d and t stems 
Heaviness and length of t-crossings 
Short d and t stems 
Long loops below the line of writing 
Strokes whipped back to the left 
Well-rounded circle formations 
Exceedingly high d and t stems 
Large capital letters or underlined words 


Final hooks at the end of a word 


ir method of determination according to Graphoanalysis. 


Correlations of the individual traits with 
the criterion revealed that many of these were 
negative, and in no case was significance 
reached. These values are presented іп 
Table 3. 


TABLE 3 
CoRRELATIONS OF TRAITS WITH THE CRITERION 
Trait Analyst 1 | Analyst 2 

Determination —.08 19 
Diplomacy —.10 —42 
Purpose —.15 —.10 
Persistence 02 —.15 
Initiative —21 —.07 
Attention to detail 101 03 
Organizational ability —.12 — 19 
Analytical ability 41 = IT 
Sense of responsibility — 18 = 43 
Pride —.03 —.05 
Enthusiasm —.07 ЛА 
Independence 06 03 
Desire for variety 14 Aa 
Correction factor | —48 —.06 
Grand total = .22 —.13 
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TABLE 4 


CORRELATION OF EMPIRICALLY DETERMINED 
TRAITS WITH THE CRITERION 


Trait r 
Enthusiasm | їй 
Like of variety ES 
Self-castigation 07 
Broad-mindedness | 01 


Vanity 08 
Independence 


The 13 traits plus the correction factor 
were used as predictors of the criterion scores 
in a multiple-regression analysis. It was de- 
cided to use the regression approach because 
the analysts selected the predictor traits in- 
tuitively. It was therefore assumed that the 
traits would have different weights in a 
prediction formula. 

The analysis was carried out independently 
for each analyst. The multiple № was .42 in 


one case and .46 for the other. Neither was 
significant. 


Part II 


A correlation of the empirically deter- 
mined traits with the criterion is presented 
in Table 4. A regression analysis using the 
six traits as predictors of the criterion yielded 
an R of .24, Again, this was nonsignificant. 


Part ПІ 


The final phase of this study consisted of 
attempting to select unsuccessful salesmen or 
"failures." For this analysis salesmen re- 
ceived a tally for each of the four traits 


TABLE 5 


TRAITS LACKING AMONG SUCCESSFUL AND 
UNSUCCESSFUL SALESMEN ACCORDING 
TO GRAPHOANALYSIS 


Trait “Successes” | “Failures” x? 
Self-confidence 11 14 .360* 
Tenacity 18 30 2.520*** 
Independence 7 12 84255 
Desire for variety: 3 10 2.1695 

Note.—Since the direction of the effect was Predicted, a 
one-tailed analysis is used. (Both trials combined) 
* .28. 


< 
wD < 19. 
wk р С 


they “lacked” according to their p arme 
The handwriting samples of the ag n 
cases (criterion scores of 3) and the е7 
salesmen used for determining the traits e i 
not used in the analysis. This left a E |} 
sample of 46, half of which were “successiu: 

and half "failures." it 

The distribution of tallies is preste d 
Table 5. Through use of a chi-square ana a 
(one-tailed) it was discovered that hd 
confidence was the least discriminating E 
On that basis it was dropped from the pre 
tive battery. 

Using the three remaining traits, oe 
with two or more tallies were classifie n 
“failures.” No prediction concerning apo 
men with less than two tallies was expe 10 
this basis the analysts selected а total O 


Ө б ir first 
"failures" out of a possible 23 in their fi 


TABLE 6 
RESULTS OF REJECTING SALESMEN 
WITH Two Low Scores 


Correct | Incorrect x 


Trial 
1 8 
2 9 3 
1 and 2 combined 17 5 


Note.— given for 
the 10 с) 


high reli; 


1 
attempt. A week later, they selected à ot 
of 12 out of 23 when the same hand ar, 
samples were recoded and presented to t 0% 

As can be seen in Table 6, less than ted. 
of the total possible failures were detec as 
However, of those who were identified 


к ме а ctua 
failures, a significant number were 2 
failures, 


Discussion 


The results of this study must be туе 
Preted in light of certain assumptions. 9 
most of these is that construct valley 
the traits was not and probably could a 
determined adequately. Rather, atte con- 
Were made at selection according to 4 


ter- 


pts 
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current validity model (see Cronbach, 1960). 
Therefore, what are referred to as “traits” 
are merely characteristic handwriting 
strokes.” 
аа also be understood that the hand- 
ees samples used in this study came ioni 

esmen currently selling life insurance 
Du the exception of four). Therefore, one 
Cie et that they met existing company 
place p in order to be hired in the first 
insura though many failures in selling life 
Gina, are to be expected, this study 

че НА ly consisted of testing the ability of 
Were analysts to identify the failures who 

ү ot screened out in the selection process 
* the life insurance companies. 
thes ьо nation of the results indicates 
bie attempts to select successful life 
Successful salesmen (Parts I and II) were un- 
selecte v The first attempt used traits 

e Ge a priori as indicative of success by 
атр or дапайузїз, while the second at- 
Were used traits that the analysts found 
Of 5 Prominent in the handwriting samples 

n ecessful salesmen. 

e „е attempt to select failures (Part TII) 
Sible = ts indicated that it may be pos- 
actual A this, although about half of the 
remain ailures, as judged by the criterion, 
Menti ed undetected by using the three traits 
toned herein, 
atte Possible that the results of this last 

ү, might in some way be contaminated 

sa repeated exposure of the analysts to 
“Very me handwriting samples, even though 
this Possible attempt was made to minimize 
Ing o quAutionary measures included uir 
Analysis е handwriting samples prior to eac 
во Inserting of “dummy” samples, an 
fro y holding results of previous analyses 
tion : € analysts, Furthermore, no informa- 
theip )nCerning the handwriting samples ОГ 
Mia: was made available to Ши, 
Оа, арз more important than the results 
€d are the implications provided by 
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this validity study. A compelling rationale 
for the results can be offered. If one assumes 
that the handwriting strokes are valid in- 
dications of certain indicated traits, can one 
necessarily assume to predict success in any 
field? The answer is, of course, no. Suc- 
cess depends not on the availability of de- 
sirable traits, but rather, on the successful 
application of these traits. 

On the other hand, if a person lacks traits 
deemed essential in a given occupation, his 
chances of success diminish markedly. On 
this basis it therefore becomes possible to 
predict failure, but not success. Using the 
same rationale, no predictive statement can 
be made concerning persons with desirable 
traits, for they may succeed or fail, depend- 
ing upon their utilization of these traits. 

In conclusion, one might state that it may 
not be possible to predict success by using 
handwriting analysis, possibly due to the 
fault of the method or possibly due to lack 
of understanding of the personality types 
that accompany success in different occupa- 
tions. It may be possible to predict failure, 
however, and future validity attempts might 
concentrate on this aspect. 
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AUDITORY S-R COMPATIBILITY: 
THE EFFECT OF AN IRRELEVANT CUE ON INFORMATION PROCESSING 


J. RICHARD SIMON anp ALAN P. RUDELL 


University of Iowa 


2 experiments demonstrated the existence of 


which affected the processing of verbal 


a strong population stereotype 
commands. In a choice RT task, Ss 


pressed the right- or left-hand key in response to the words “right” or “left” 


which were presented to the right or left 
the content of the command corresponde 


did not; ie. information Processing was affected by 


task itself, the ear in which the command 


regarding the ear to be stimulated resulted in signi 


reduced but did not eliminate the effect 


A fundamental problem in man-machine 
system design is that of integrating display 
and control elements so that the information 
presented can be processed efficiently into 
appropriate control action. To facilitate in- 
formation processing, the human engineer 
seeks to conform to population stereotypes; 
that is, he designs displays so that they give 
a “natural” indication of the correct response, 
This occurs, for example, when the spatial 
arrangement of the display Corresponds with 
that of the control (Fitts & Seeger, 1953; 

Garvey & Mitnick, 1955). Fitts and Seeger 
use the term S-R compatibility in referring 
to the extent to which the ensemble of stim- 
ulus and response combinations comprising 
the task results in a high rate of information 
transfer. 


Up to now, the concepts of stereotype and 
compatibility have been applied almost ex- 
clusively in the realm of visual displays 
(Fitts, 1951; Loveless, 1962; McCormick, 
1964). A notable exception is a study by 
Mudd (1963) which demonstrates that di- 
mensions of pure tone (frequency, intensity, 
and interaural intensity difference) have д 
natural tendency to be associated with hori- 
zontal and vertical dimensions OÍ space, 
Mudd's research has been concerned with re- 
ducing visual search time by providing S with 
additional relevant auditory cues (Mudd, 
1965; Mudd & McCormick, 1960). 'The con- 
cern of the present study is with auditory S-R 
compatibility, that is, the role of ir 


relevant 
directional cues imbedded in the 


auditory 
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ear. RT was significantly faster when 
d to the car stimulated than when it 
а cue irrelevant to the 
was heard. Removing S's uncertainty 
ficantly faster RT, and 
of the irrelevant directional cue. 


display itself which interfere with Mame 
processing. Data to be presented indicate зең 
the interpretation of a verbal directional pid 
mand is affected by the ear in which the CO 
mand is heard, dy 
The major findings of the present o. 
Provide an excellent example of serendip'3: 
The original purpose of this study was to u- 
Vestigate the interaction between ear Mm 
lated and handedness in an auditory reat es 
time (RT) task. A number of recent p pi 
indicate that the right ear is more e 
than the left in perceiving verbal materi is 
under dichotic listening conditions, that ШШ 
simultaneous presentation of different po 
to both ears (Broadbent & Gregory, p 
Bryden, 1963; Kimura, 1961b, 1963). been 
Sreater right-ear effectiveness has p aspe 
interpreted to indicate right-ear superiority ^ 
such but rather the superiority of the ch. 
Opposite the dominant hemisphere for m es 
Kimura (19613) found that, when speech | 
represented in the left hemisphere, the г< 
car was more efficient, but, when speech left 
represented in the right hemisphere, the en 
ear was more efficient. The aim of the poris 
Study was to extend these dichotic pape 
results to a Monaural RT task. It was P 
dicted that right-handed Ss (presumed tO 5» 
almost exclusively left-hemisphere dam 
Would respond faster to a verbal comm eas 
in their right ear than in their left, whet 
left-handed Ss (a majority presumed {0 re 
right-hemisphere dominant) would tend to 
Spond faster to commands in the left еаг. 


ке = 


AUDITORY S-R 


EXPERIMENT I 


ш The apparatus provided a measure of 
еи to а series of monaural verbal com- 
Stadler p were presented to S through Grason- 
Keys ye H-39 matched earphones. Two telegraph 
stein Bs positioned 10 in. apart on a table sur- 
right ke сан of 5. Instructions were to depress the 
word «У Ec quickly as possible after hearing the 
аз рсы) апа {о depress the left key as quickly 
rested di S after hearing the word “left.” The 5 
ће оа primns on the table surface and, upon 
On the k 9 а ready signal, placed his index fingers 

eys. The ready signal was presented 2 sec. 


prio; 2 
ы each command and consisted of the simul- 
80-db 5 onset of a warning light and a 1000-cps, 


unter a os tone of 500-msec. duration. А 
Presented ocKounter started when the command was 
epressin and stopped when S pressed the key. 
key had j^ the key also signaled E as to which 
Commands een pressed. The instructions and verbal 
70 db. by Were recorded on tape and presented at 
а 6-sec. pe Sony TC 500 Stereocorder. There was 
roced erval between commands. 

SPonded ad and experimental design. Each S re- 
mands pp Ве same series of 132 prerecorded сот. 
or the a command consisting of the word “right” 
о аьаа "left." The commands were presented 
Mined rans right car or the left ear in a predeter- 
» prior lom sequence. The S had no way of know- 
Which ear to the presentation of each command, 
mang oup. nid be stimulated or what the com- 
trials in d be. The first eight trials were practice 
© pr Which the “right” and "left" commands 
Order, esented twice to each ear in a random 
Subgroy 9r half of the Ss in each Sex X Handedness 
the earphones were reversed in order to 
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balance out any differences which may have existed 
between the two stimulus channels. 

Subjects. Two groups were used, one of 48 selí- 
classified strongly right-handed Ss and the other of 
32 self-classified strongly left-handed Ss. The Ss 
ranged in age from 18 to 28 (average age 19.7). 
There was an equal number of males and females 
in each handedness group. The Ss all passed a 
standard audiometric screening test in which pure 
tones of 500, 1000, and 2000 cps were presented to 
each ear separately. No S had a hearing loss greater 
than 10 db. at any one of the three frequencies 
tested. Each S also responded to a short handedness- 
questionnaire indicating the hand he used to write, 
turn a screwdriver, throw a ball, hold a toothbrush, 
and swing a tennis racket. All of the right-handed 
Ss reported that they used their right hand ex- 
clusively for these activities while three left-handed 
Ss reported using their right hand for one of the 
five activities queried. 

Results. Median RTs were computed for each 5 
for each of the four experimental conditions, that 
is, “right” and “left” commands in the right and 
in the left ear. Trials on which anticipations or 
incorrect responses occurred (about 1% of the 
trials) were omitted. 

Table 1 summarizes the mean RT under each 
treatment condition for each Sex X Handedness sub- 
group. Analysis of variance revealed no differences 
as a function of the main effects of ear stimulated, 
command, or handedness group. There was, how- 
a significant difference between the sex 
p < 05—with males re- 
sponding faster than females (391 versus 426 msec.) . 

The predicted Ear Stimulated X Handedness in- 
teraction was not significant—F (1/76) — 1.95, al- 
though, as Table 1 indicates, the differences were in 


ever, 


groups—F ( 1/76) = 5.02; 


ТАВІЕ 1 
Rune 
кн Time то VERBAL COMMANDS AS А FUNCTION OF EAR STIMULATED, HANDEDNESS, AND SEX 
| = “Males Females 
© z ta M ear 
Toup = d Command Command о 
FEARS m 
“Right” “Left” | M “Right” “Left М 
Ri ш 4 | 
i | 400 441 421 
h Right ea 63 413 388 0 404 
anders | Left ear ati 375 393 445 406 426 400 
Mo 387 304 391 423 424 423 407 
Ге 
t 
i 434. | — 430 
h Rig! 3 406 391 426 "m 
Anders DET p 352 390 458 400 429 408 
À “Mo 402 379 390 442 417 429 pra 
Ar of hana 
“песа 
Broups 
"ед 393 388 391 430 421 426 


Experiment I Experiment I 


+----* RIGHT COMMAND 
e——À LEFT COMMAND 


: 


ë 
: 


REACTION TIME (milliseconds) 


8 


1 


1 1 
IGI EAR LEFT EAR RIGHT EAR LEFT EAR 
EAR STIMULATEO 
Fic. 1. Effect of ear stimulated on RT to verbal 
directional commands, 


the expected direction with rig 
respond faster to right-ear stimulation and left- 


handers showing the opposite tendency. A chi-square 
analysis indicated that a 


ht-handers tending to 


responded faster 
he left-ear trials 


groups did not differ s 
proportion of Ss showing 
234; p> 10). The ana 
à significant Command 
F(1/76)= 11.82; $ < .01—which reflects 
that right-handers tended to respond faster to the 
“right” command (Le, with their right hand), and 
left-handers tended to respond faster to the “left” 
command (ї.е., with their left hand), 
By far the most conspicuous result Was the sig- 
nificant Command X Ear Stimulated 
F(1/76)— 226.50; р < 001. The lef 
pictures this effect. It will be noted that RT was 


ignificantly in the relative 
right-ear superiority (x? = 
lysis of variance revealed 
X Handedness interaction — 


interaction— 


EXPERIMENT II 


The purpose of this experiment was to 
determine whether the irrelevant cue noted in 
Experiment I (i.e., ear stimulated) would con- 
tinue to affect RT if § knew which ear would 
be stimulated prior to Presentation of the 
command. It was conjectured that, as a result 
of removing 5's uncertainty as to the source of 
the command, the variance contributed by 
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this irrelevant cue would be eliminated ап 
the hypothesized interaction between [o 
stimulated and handedness might then 
detected. 


i he 
Apparatus, procedure, and experiment al ee 
apparatus was the same as that used ш Espey Is were 
The procedure, however, differed in that ae ae 
Presented in blocks rather than in the M on two 
order employed previously. Each S performed mands 
blocks of trials, one block in which the ae block 
Were presented to his right ear and the ot s left 
in which the commands were presented P trials 
саг. Instructions prior to each block o nands 
stressed the fact that S would hear the Ve the 
in his right ear only or in his left ear only jals ap- 
case may be. Each block consisted of 62 test right" 
pearing at 3-sec, intervals in which the word ro 
and the word “left? appeared an equal numi Each 
times in a predetermined random Seguros se 
block was preceded by four practice trials mandi 
9f two "right" commands and two “left” com pre- 
The instructions and verbal commands were 
recorded and presented at 70 db. I (Lind- 
The design was an extension of a Type V yithin-: 
quist, 1953) with two between- and two Handed- 
dimensions. Half of the 16 Ss in each Sex X ] Is first 
hess subgroup performed the right-ear tria trials 
While the other half performed the left-car same 
first. By simply reversing the headset, s right- 
random series of commands was uscd for both 
and left-ear blocks of trials. Й f Iowa 
Subjects. The Ss were 64 University 0 of 18 
undergraduate volunteers between the ages used; 
and 29 (average age 20.0). Two groups were d the 
one consisted of 32 strongly right-handed 5s um 
Other of 32 Strongly left-handed Ss. There we 
men and 16 women in each group. ic screen- 
All Ss were given a standard audiometric $ than 
ing test, and none had a hearing loss greater cies: 
10 db. at any one of three “speech” феде the 
300, 1000, and 2000 eps. The Ss then complet? Ex- 
same handedness-questionnaire that was used n left- 
periment I. All of the right-handed Ss and 2 d ex- 
handed Ss Teported using their preferred өү left- 
clusively for the 5 activities queried; whereas either 
handed Ss reported using their right hand or 
hand for 1 or 2 of the tasks. each 5 
Results. Median RTs were computed Shem 
under the four experimental conditions, he 
"right" and “left” monaural commands in п о evi- 
and left ear, Analysis of variance provided edness 
dence of the predicted Ear Stimulated X Han to the 
interaction. There were also no differences dus aded- 
main effects of ear stimulated, command, or Faction, 
ness group. The Command х Handedness ine e 
Which was Significant in Experiment 1, ан fe- 
replicated. Males tended to respond faster ference 
males (372 versus 396 msec.), but the di ance“ 
failed to reach an acceptable level of signific right- 
P(1/60)= 2.64; p > ло, The difference benan for 
and left-ear trials was different for males thí 
females—P (1/60) = 5.98; p<.05. 
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= T Experiment I, the major source of variance 
hice X Ear Stimulated interaction— 
igt h mo Ф < .001—which is pictured in the 
cor iib of Figure 1. It will be noted that the 
ван pen le reachons, that is, “right” in the right 
ан left in the left ear, were significantly 
in the m the incompatible reactions, that is, "right" 

P eft ear and "left" in the right ear. Mean 

or the two compatible conditions was 371 msec. 


Vers Ё m 
Con 397 msec. for the two incompatible conditions. 
n 


асіна 


rocedure between the two was that, in the latter 
instructions were used to remove 55 
regarding the саг in which the command 
ат. In the former experiment, on the 


the combined data from the two ex- 
dicated that Ss responded significantly 
Periment II than in Experiment I (38+ 


he income. there was a relatively greater speedup 
Teflecteg Compatible reactions. This latter effect was 
x хрен а significant Command X Ear Stimulated 
O01. p, quent interaction —7(1/140)— 14.975 Р < 

Experi random саг order presentation employed 
Compatible ent 1, the average difference between 
This diff © and incompatible reactions was 42 msec. 
Ment pretence was reduced to 26 msec. іп Experi- 
Would Where Ss were told in advance which ear 

© stimulated. 


DISCUSSION 


R 

aa clearly indicated that speed of 
“tiep US verbal commands (i.e., the words 
лаја a "left") was affected by a cue 
in Whign 19 the task itself, that is, the ear 
апу, the command was heard. RT was 
Comm АЧУ faster when the content of the 


(ie, 4d corresponded to the ear stimulated 
cary gout in the right ear or “eft” in leít 
le; АП when it did not (ie. “right” in 


ws responded 
Risg E Ponded " 


Comm 
(е; 


to this population stereotype, 
apidly. However, when conflict 
etween the symbolic cue (content of 

in, s a and the irrelevant directional cue 
ч ос mulated), a marked delay in respond- 
штей. Tt was as if Ss had to inhibit 
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the stereotypic directional response before re- 
acting to the symbolic content of the com- 
mand. 

The data underline the potency of the 
stereotype in question. The irrelevant cue was 
particularly influential in Experiment I where 
Ss were uncertain as to which ear would be 
stimulated. Removing this uncertainty in Ex- 
periment II significantly reduced but by no 
means eliminated the effect. 

Questions still remain as to the generality 
of the findings. Is the stereotype specific to a 
bimanual task such as the one employed in 
the present study where S responds with the 
body member on the same or the opposite side 
as the ear stimulated? Or would the same 
irrelevant cue operate in a unimanual task 
where, for example, S moves a lever to the 
right or left from the midline of his body in 
response to verbal commands? 

Auditory displays have not been widely 
used for providing directional information in 
man-machine systems (McCormick, 1964). 
“Flybar” (Chapanis, Garner, & Morgan, 
1947, ch. 9) represented an early attempt 
to provide pilots with spatial information by 
means of complex auditory signals. Present 
results suggest that additional basic studies 
are urgently needed. One potentially promis- 
ing avenue for research would involve at- 
tempting to increase the speed of processing 
directional information from an auditory dis- 
play by utilizing the cue provided by the ear 
stimulated. One wonders whether Ss would 
respond faster to a combination of directional 
and symbolic cues (“right” command in the 
right ear or “left” in the left ear) than to 
directional or symbolic cues alone. 

Other results bear mentioning because of 
their relation to previous research. The find- 
ing that men responded significantly faster 
than women supports the oft-noted tendency 
for male superiority on RT tasks (Teichner, 
1954: Woodworth & Schlosberg, 1955). The 
tendency for the right-handed group to re- 
spond faster to right-ear stimulation is con- 
sistent with recent findings of ear preference 
in auditory perception (Borkowski, Spreen, & 
Stutz, 1965; Bryden, 1963; Dirks, 1964) and 
supports the view that Ss tend to tune in with 
their right ear when they are uncertain as to 
which ear will be stimulated. 
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MULTIDIMENSIONAL SCALING ANALYSIS OF DECISION 
STRATEGIES IN THREAT EVALUATION ' 


JOSEPH W. RIGNEY AND CHARLES H. DEBOW 


University of Southern California, Los Angeles 


Similarities analysis was used to identify the combinatorial strategy used by 
naval officers in evaluating the relative threat of paired air-raids presented on 


ап air summary plot. 63 Combat 
judged the similarity, in terms of threat 
raids, varying in range, course, 
threat value of each raid subsequently 


Information Center (CIC) watch officers 


value, of all different pairs of 20 air 


bearing, composition, altitude, and speed. The 


was estimated, using a 9-point scale. 


It was found that the judgments of threat value were based primarily on 


range and course of the raids. 


For decte: 

of "өы tasks in which the outcome is 
Ng is s Consequence and the time for decid- 
and medi: rt, as in many military, business, 
са "nis decisions, the strategy the de- 
er na uses is of special interest. Given 
on, does р variables in the decision situa- 
Simplify th е consider all of them or does he 
è Weighted o situation, when he has to form 
"s ttive ee of variables in order 
BONA on te Bene Shepard (1964b) 
S effortle the “obvious disparity between 
er and surety of most per- 
‚ Кой ES and the painful hesitation 
Siong [ aracteristic of these ‘higher level’ 

зе рез pen 
е ju ан study was designed to analyze 
eig ext uM of military decision-makers 1 
ton ЕМУ analogous to the actual de- 
азу Med ae environment. The study was 
Т едЕ ith threat evaluation and weapons 
tities in anti-air warfare. In the study, 
analysis, or multidimensional 
May? Shepard, 1962a, 
Чуге Gerson, 1958, 1965), was used to 
TIS wei ee makers go about as- 
rahe fe Ehts to a number of attributes of 
чес [e reported in this paper are а part of 
К Nat t e шаш (Rigney & DeBow, 1966) spon- 
Nang, Гаа and Training Branch, Office 
эч, Bureay ch; and the Psychological Research 
8(22). of Naval Personnel, under Contract 


196 18 
962p (Kruskal, 1964; 
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air raids and combining these weights into a 
single measure of the relative threat of these 
raids. 

There is a great deal of evidence from 
studies of similar judgmental problems in 
other contexts that humans unknowingly 
simplify the decision situation by concentrat- 
ing on one or two salient characteristics of the 
objects and ignoring the others (DeSoto, 
1961; Meehl, 1954; Miller, 1956; Shepard, 
1964b; Yntema & Torgerson, 1961). 

Cliff (1965) investigated a similar problem 
using a different kind of stimuli. He deter- 
mined a multidimensional space from dis- 
similarity judgments of pairs of facial ex- 
pressions and also had ratings made of the 
intensity of the emotions conveyed in each 
expression. He found that these latter, in- 
dependently obtained, unidimensional judg- 
ments could be reproduced from the locations 
of the expressions in the multidimensional 
space. 

In the context of this study, this simplifica- 
tion might not necessarily be bad from an 
operational standpoint, if the one or two vari- 
ables that were selected were indeed the most 
important ones in determining threat, and if a 
simple combination of these weights could 
redict most of the threat variance. But it is 
still highly desirable to know if this is the 
strategy used, and, if so, exactly what are 
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A Raid, Composition: 


Few 
Raid, Composition: Many 
Speed: Slow 
Speed: Fast 
Altitude: Indicated in 


box in lower left. 
No. X 1,000 £t. 
Fic. 1. Example of air summa! 


© САР 
ange rings - 20 miles 


Own ship position: Center 
of plot. 
Own ship course: 000 


i 
М show? 
: { ty plot. (The legend translates symbols on display. All raids a 
this figure. During the experimental Presentation, only one pair of raids was shown at a ti 


the weights and how they do combine, Other 
purposes of the study were to: (a) determine 
the suitability of using the multidimensional 
scaling technique for analyzing this aspect of 
decision making, and (5) estimate the ability 
of decision makers to make reliable similarity 
judgments of stimuli as complex as those used. 


МЕтнор 
Subjects 


63 D” gs 
The subjects (Ss) in this study жене 63 E: 
Officers and noncommissioned officers. tion Сё 
were enrolled in the Combat ио n! pit 
Watch Officer Course, C-351, at the F Califo” 
Warfare Training Center, San Diego, 


| 
| 
| 
à 


» 
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TABLE 1 
COMBINATIONS OF VARIABLES USED TO DESCRIBE INDIVIDUAL RAIDS 
Stimulus sim Speed А Altitude Range 
i Composition (knots) Bearing Course (X 1000 ft.) (miles) 
1 Few 800 270 0 30 60 
3 250 40 10 80 
" 310 80 30 100 
5 230 120 10 120 
6 800 340 140 30 140 
1 400 90 180 10 60 
8 100 320 30 80 
9 40 260 10 100 
10 150 220 30 120 
11 Few 400 20 180 10 140 
12 Many 800 70 200 30 60 
13 110 240 10 80 
14 50 280 30 100 
15 130 300 10 120 
16 800 10 340 30 140 
17 400 280 20 10 60 
18 240 80 30 80 
19 320 100 10 100 
20 210 140 30 120 
Many 400 340 60 19 0 
Note. тр 
This order was randomized in all presentations. 
ere ұу 
The у t€ four classes, separated by 2-wk. intervals. Procedure 


“ach 4. ee collected from Ss on the last day of 
е toa 
ane 9 te Course was designed to familiarize 
Co? and With the equipment, operations, dis- 
"ibat Inf symbology utilized in the shipboard 
4 ormation Center (CIC). 
Фрау 
The 5 
s 
di Awk, сор Seated in the same classroom in which 
: j Pa had been administered. A 35-mm. 
с see with an automatic interval timer 
Wera CN at thy was used to project the stimuli onto 
Same Projected. front of the classroom. The stimuli 
Qe size ted in a manner which maintained f 
lor re е tionships of the symbols and plotting 
Зеб to Mud Room illumination was sufficient 
Rag ind still « written responses on their answer 
ты Btojected the projected stimuli clearly. 
bl, йад Cted slide contained a pair of symbols, 
Cre The slide т raids, plotted on а СІС air summary 
Comp splay were color photographs of an actu 
Wag dations he pairs of raids covered all possible 
ia "сар (190) of 20 individual raids. Each raid 
fo, 20 ts. ed once as a check on reliability of S's 
BN Sec, [d there were 210 slides, each projected 
Yed in ion 1 depicts each of the 20 raids 
> Study. 
~ tistics of the raids varied in terms of 
Compositi ES bearing, course, speed, altitude, 
X Alu on (number of aircraft in the raid). 


ОЁ each of these variables are given in 


The Ss were required to make two types of judg- 
ments. In the first judgment, a similarity value, 
ranging from 1 through 9, was to be assigned to 
each pair of the 210 pairs of raids, presented one 
pair at a time. This value concerned the degree to 
which members of a pair were similar with respect 
to threat to the S's ship. The value of 1 represented 
raids very similar їп threat; 9 represented raids very 
different in threat. The numbers between 1 and 9 
represented intermediate gradations of similarity. 

Prior to the administration of the first task, Ss 
reviewed a "summary of situation" which contained 
necessary information concerning ship position, 
weather, sea state, friendly aircraft, weapons avail- 
able, and the general nature of potential threats. 

The second judgment involved estimating the 
threat value of each of the raids, presented in- 
dividually for 20 sec. The Ss were asked to assign 
threat values ranging from 1 to 9 to each raid; 
1 represented minimum threat, and 9 represented 
maximum threat. This was done to provide a threat 
reference ог composite scale, for interpreting the 
results of the multidimensional analysis. 


RESULTS 
Reliability 
Since the outcome of multidimensional scal- 
ing is dependent upon relatively stable simi- 
larity judgments, it was necessary to estimate 
the extent to which Ss could make reliable 
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TABLE 2 


LOADINGS ОЕ 20 Arr Rams on THE FIRST DIMENSION 
AND MEANS OF THREAT VALUES ASSIGNED 
THE Rams By 32 CIC OFFICERS 


Raid Mean threat value] First dimension 
1 6.19 32 
2 743 -36 
3 6.19 ET 
4 3.56 —47 
5 4.63 —.28 
6 5.97 —.19 
7 6.59 .20 
8 5.00 —.06 
9 1.84 ~ 16 
10 3.78 — 46 
11 8.19 158 
12 7.13 и 
13 6.25 .26 
14 6.84 48 
15 2.47 =@ 
16 7.41 51 
17 7.06 48 
18 5.91 27 
19 2.03 185 
20 21 E 


responses to the paired stimuli, The 20 repli- 
cated items yielded stability reliabilities that, 
for half the sample, were below the .05 level 
of significance (7 = 48). Data for this half of 
the sample, 31 Ss, were not used in the 
multidimensional analysis, 

The principal objective of the study was to 
determine the extent to which the six vari- 
ables—range, bearing, Course, composition, 
speed, and altitude—influenced S's judgments 
of raid threat value. Considering the evidence 
from other studies, it was assumed that the Ss 
would simplify the judgmental problem by 
ignoring all but the one or two most important 
of the six variables. 

The multidimensional scaling 
which the data were analyzed 
indicators for determining mi 
sionality. A large break in the 
roots suggests the rank of the 1 
goodness-of-fit index indicates 
which a given n-dimensional so 
interstimulus distances derived 


program ? by 
provides two 
nimal dimen- 
Size of latent 
matrix, And, а 
the degree to 
lution fits the 
from S?s judg- 

?W. S. Torgerson and С. E. Mu 
notes on Torgerson & Mueser's IBM 


for Multidimensional Scaling. Mimeo, 
1962. 


eser. Informa] 
7090 Program 
graphed paper, 
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ments. An examination of the latent (ue 
vealed a large difference in magnitude CS H 
the first and second roots, suggesting rep- 
one-dimensional solution might «аг the 
resent the data. As would be Lom fume 
goodness-of-fit index improved with zi being 
ber of dimensions that were extracted; 
higher for six than for one. st 
The loadings of the 20 air raids on s 
dimension are given in Table 2, along nd tas 
threat scale obtained from the Sie value 
given the Ss, that of rating the pap A 
of each single raid. This composite г 
threat of the 20 stimuli was used ultiple- 
criterion variable in a step-wise ene i- 
regression analysis in which the first nalysis 
mensions of the multidimensional а 
were the predictor variables. Table 2 
It is obvious from inspection of ' ension 
that the threat scale and the first € 08; 
are highly correlated. This joe rtm yari- 
the first dimension predicts 96% of correla- 
ance in the threat scale. The multiple nd the 
tion between the first two dimensions is he 
threat scale was still only .98. opa al he 
first dimension accounts for practical Y diction 
variance in the threat scale, and the Prnension- 
is not improved by adding another pet 
Multiple-regression analyses Were e» com 
in order to identify the raid variab The $ 
posing the first dimension (Table 3) "portant 
Considered range to be the most "i in imr 
determinant of threat, with course pcd ài ded 
portance. The other four raid variables 2" - 


а with 
nothing of significance to the multiple 


TABLE 3 Е5510% 
PARTIAL CORRELATIONS, Милтрьк-ЁкӨР 3 
COEFFICIENTS, AND PROPORTIONS O 

PREDICTED FOR THE MULTIPLE 
CORRELATION оғ DIMENSION 
ONE wirta RANGE AND 
COURSE VARIABLES: 


R= .93 

= ortio 

Partial Multiple- pur га 

Correlation | regression predict 

coefficients | coefficients a 

63 
Range (X) 90 .52 ‚223 
Course (X;) 78 :31 7 

y’=.00 + # 


Note.—Multiple-regression equation: 
+ .31X2, 


wi 


` multiple 
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thi: H . + 
S dimension. The first dimension can be 


interpreted ; 
as a c 
course, omposite of range and 


CONCLUSIONS 


i cs ultidimensional scaling can be used to 
У the combinatorial strategy used by a 
Sot of CIC officers in making | А 
judgments of rs in making comparative 
: of threat value from character- 
tics of paired rai 
recovered ; raids. In effect, the procedure 
Scale misi ts the first dimension the threat 
related 9g y the group. This dimension cor- 
:98 with the composite threat scale. A 
Cegression analysis of this first di- 
revealed that it was a composite of 
and 2204 hein ee accounted for 64% 
ance, The espectively, of the predicted vari- 
in the ano 5 a R was .93. Evidently, Ss 
contentis simplified the decision situation 
atacteristice S on only two of the six raid 
and did p ics when estimating threat value 
ANY sions ot utilize the other four variables to 
Bnificant extent. 
fac E inability of many Ss to make satis- 
thre oe comparative judgments of 
Чеге - of paired raids might be con- 
taining 0 have significant implications for 
for thea n Addition to the problem it poses 
to analyz ication of multidimensional scaling 
tive] dem judgments based on these rela- 
a Wou Hi stimuli, The question for train- 
° Make whether or not Ss can be trained 
Ша More reliable threat judgments, and 


Tension 
Tange an 


ш te a cant methods. The problem for 
the тры у of similarities analysis to 
"a reliabili stimulus material is to improve 
EL B i ity of judgments. Although the 
the ar and the symbols used in the 
a Боз] those used in shipboard CICs, 
DUM d did not represent the raid char- 
tar task ы п а fashion that was optimum for 
ea › dene the CIC officers. For example. 
Dow’ to rse, and bearing probably were 
dint n. Visualize than altitude and com- 
es sional, ot the display was not three- 
M; teq, and. altitude was not graphically pre- 

апу? апа the distinction between one and 


N 5: depended on a very small exten- 
Weyer ide of a triangular symbol. | 
-^ the primary problem for reli- 
ау lie in the nature of the stimulus 
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material. It has been hypothesized (Shepard, 
1964a) that Ss attend first to one sub- 
set of attributes and then to another in- 
dependent or overlapping subset on successive 
presentations of complex stimulus material. 
It is possible that they change their strategies 
between successive presentations. Perhaps 
more attentional fluctuation and strategy 
changing is to be expected when the judg- 
mental task concerns a conceptual rather than 
a perceptual structure. 

Tn this regard, the application of similarities 
analysis in this study is a type of applica- 
tion discussed by Torgerson (1965) as more 
cognitive than perceptual. He discusses the 
problems of applying the technique to describ- 
ing cognitive structures, suggesting that simi- 
larity in this case is 
sensitive to all of the delicate problems of attitude 
trategy involved in decision-making tasks in 
general. Here, degree of similarity is not an in- 
variant relation between à pair of stimuli, but 
rather depends on such things as stimulus context 
[pp. 389-390]. 


and s 


Thus, in this case, the potential threat of the 
raids supplied a strong context which deter- 
mined the characteristics of the similarity 
judgments. If another context were supplied 
{ог the judgments, it is highly likely they 
would be different. This and the reliability 
question are both deserving of further study. 

3. Steps were taken in this study toward 
objective and quantitative analysis of im- 
portant human-decision processes. Та addition 
to the implications for further research, the 
analytical procedures have potential uses as 
criterion measures in training threat eval- 
uators, and as sources of dependent variables 


in the design of displays and symbols. 
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IMPROVING INSPECTOR P 


ERFORMANCE THROUGH 


TRAINING AND VISUAL AIDS 


FRED B. CHANEY лхо KENNETH 5. TEEL 


Autonetics, A Division of North American Aviation, Inc., 
Anaheim, California 


An experimental study was performed 


to evaluate, singly and in combina- 


tion, the effectiveness of a 4-hr. training program and a set of visual aids 
designed to improve the performance of 27 experienced machined-parts in- 
spectors. The criterion used was the percentage of true defects detected in a 
selected sample of machined parts. Findings indicated that (a) use of train- 


% 


ing alone resulted in a 32% 


p js inspection performance is essential 
Manufactures» of any organization which 
is pattie? assembles, and sells a product. 
nizati ularly critical, however, to those 
Which jg Ons that build precision equipment 
of time oe to operate for long periods 
Conditions e a wide variety of environmental 
for е S. For this reason, the authors have, 
Seties i ud Several years, been conducting а 
tion pe Studies designed to improve inspec- 
е Formance, 
Was s. d of the study reported herein 
ш fue uate the effectiveness of training 
Ance g = aids in improving the perform- 
achin o hined-parts inspectors. — — 
“hose ; ne Parts inspectors are individuals 
Parts E 15 to examine precision machined 
defects which might make them un- 
Bre à. use, The two items used in this 
e ks, Shown in Figure 1; both are typical 
А aot parts inspected. a 
је а Subjects $ are examined for both objective 
hi ive Cate ive defects. Included in the ob- 
ah Xs, een, are such defects as mislocated 
D tien holes, lack of parallelism 
Do the Subj “city, and improper dimensions. 
gs fina Ctive category are such things as 
dest lecte? Statches, and nicks. A part may 
Sets. CT for either objecti ubjective 
y exper: : jective or 5 ] 
Derience indicates, however, that 
efects are far more serious and 
are the reasons for most rejections. 
Part is either returned to man- 
Or rework or scrapped. Although 
_Scrappage are expensive even at 
> Àt is far more expensive to allow 
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ese p 


п increase in 
aids alone resulted in a 42% increase, and (c) use о ] 
increase, while (d) performance of the control group did 


defects detected, (b) use of visual 
{ both resulted in a 71% 
not change. 


a defective part to be incorporated into a 
delivered product and subsequently to have 
that product returned by the customer. Thus, 
while the stated goal of inspection is to 
maximize the number of legitimate defects 
detected and to minimize the number of false 
ones, it appears to be better, when in doubt, 
to err on the side of rejecting an item rather 


than accepting it. 

One of the reasons machined-parts in- 
spectors were selected for study was that 
previous informal investigations had indicated 
that these inspectors were identifying less 
than 5095 of the objective defects in the 
items reviewed. 


METHOD 


Job-sample performance measures were used to 
divide 27 machined-parts inspectors into four 
matched groups. One group served as a control, 
A second was given a specially designed 4-hr. train- 
ing program. A third was given both the training 
and visual aids. Subsequently, equivalent job- 
sample measures were again obtained for each of 
the groups. The Control group used standard draw- 
ings and specifications as inspection aids for both 
the "before" and "after" measurements. The train- 
ing and/or visual aids were introduced in the other 
three groups as part of a continuing research pro- 
gram which had been carried out, with full manage- 
ment support, for 2 yr. prior to the study. Con- 
sequently, Ss accepted the experimental treatments as 
part of their normal work environment, not as 
implied criticism of their previous performance. 
All Ss carried out their normal duties during the 
6 mo. between testings. Statistical comparisons were 
made of the differences in performance among 
groups, and of the differences in "before-after" per- 
formance within each of the groups. 


Fic. 1. Sample parts. 


Subjects 


The Ss were 27 machined-parts inspectors, the 
full population available in the organization. Their 
median age was 49, with a range from 28 to 62. 
Their median inspection experience was 8 yr, with 
a range from 3 to 20. Their median tenure with the 
company was 6 yr. with a range of 4-17. Thus, Ss 
were mature, experienced inspectors wh 
ance presumably had leveled out. Therefore, it 
seems safe to assume that incidental learning during 
the course of the study probably had little or no 


effect on the final performance levels of the various 
groups. 


ose perform- 


Job-Sample Test 


Four machined parts were fabricated for use in 
the study. Two were brackets; the other two were 
motor supports. One of each was shown in Figure 1. 
All four items were fabricated to contain a rep- 
resentative sample of known defects. Each of the 
items was then inspected independently by four 
men, two leadmen and two engineering Supervisors, 
The four then met as a group and agreed on master 
lists of characteristics to be inspected and defects 
present in each of the four parts. Each of the four 
parts had approximately 100 characteristics to be 
inspected and 34 defects, 

Both the "before" and “after” 
of the groups were obtained b 
independently inspect one bracket and one support, 
The initial measures were obtained With half of 
the Ss inspecting Support 1 (S;) and Bracket 1 
(B;), and the other half inspecting Support 2 (S2) 


measures for each 
y having each $ 
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Synchro Bracket | 


and Bracket 2 (Bz). The final Em 
were obtained by having Ss inspect ; thus, thos? 
parts they had not inspected previously i 

who inspected 5, and В, initially, inspecte 
later, and vice versa, 


Group M. atching 


m 
The initial job-sample test yielded four 
of performance for each of the 27 me ts 
Were (a) percentage of objective de detecte Tu 


: tion 
number of false detections, and (d) inspec ^". 


Statistical tests revealed that the grote oe 
differ significantly on any of the other ee ted 
he equivalence of the four groups is 1 
Table 1, 
Training Program 107 
& isted of 0 gach 
The training program consisted 


1507. 4 g 
sessions conducted by the inspection арс di, 
session included a Jecture, demonstrate. e 
question-and-answer period. The four Sae mease 14 
mspectively, with the topics of (a) precisi сей 
ment, (b) thread gaging, (c) use of 


$ jon 0! реек 
Internal Comparator, and (d) interes a wee! 
ing notes. The sessions were conducte к 


ей 27 
for 4 wk. Approximately a month Flap ratio? 
the end of the training and the admi 
the final job-sample test. 


э 
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= TABLE 1 
GROUP PERFORMANCE LEVELS BEFORE THE STUDY 


Group means Analysis of variance 
Performance | Training | 
measure zs ual Adds | plus Visual 
pa^ DOW у m" 7) ae Fic MS groups | MS error Ез ratio 
W=7) 
P 
&rcentage of objec- 35.7 30.5 37.6 34.3 57.3 97.6 59 
is Ve detections 
centage ofsubjec-| 53.6 51.5 47.0 54.0 77.1 75.0 1.03 
ne detections 
Tu false detections 23 7.0 5. By 30.9 145 2.13 
5 “MPection time 114 12.7 12.7 11.1 48 8.7 ‚55 
Ours) n 


~E (3/23) = 2,34. 


The 
с 3 , : 
Specific Ourse contained no information on the 


ion efects contained in the job-sample parts, 
th © of the Ss saw those parts except during 


test Sessions, 
Visual 4 ids 
T 


he yi 
* Visual aids consisted of a series of simple 


ray, 

in 

and ind the sample parts—six for the bracket 
= or th drawings 

\ Shown in hie” One of those drawing 


The dimensions and tolerances for each char- 
acteristic to be inspected were placed on the draw- 
ings to minimize the need for calculation or reference 
to other materials; these data typically had been 
presented on one master blueprint and in written 
instructions. Furthermore, similar items were grouped 
on a single page to encourage the inspector to ex- 
amine the part fully for one class of defects before 
reviewing it for others. The visual aids were pre- 
pared by an experienced inspector who was not an 


DA 
TUM "ge фор (3) 1.995*010 DIAMETERS PARALLEL TO SURFACE PLATE. 


Fic. 2. Sample inspection drawing. 
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ТАВГЕ 2 
OBJECTIVE DEFECT DETECTION 

Percentage of " 
defects detected pee: 

Group age о! 
change 

Before After 

Control 35.7 33.4 —6 

Training 30.5 40.3 32 

Visual Aids 37.7 53.4 42 

Training plus Visual 34.3 58.6 71 

Aids 


S in the study and who did not know what specific 
defects were contained in the sample parts. 

No training was given in the interpretation or use 
of the visual aids. The Ss were simply given the 
drawings immediately before their final inspection 


of the two parts and told to use them in carrying 
out the inspection. 


RESULTS 


Since four different measures of perform- 


ance were obtained, the results are presented 
separately for each. 


Objective Defects 


Results indicated clearly that use of either 
training or visual aids resulted in significant 
gains in objective detection performance, and 
that use of both resulted in even greater 
gains. These findings are presented in Table 2. 
It will be noted that there was no significant 
change in the performance of the Control 
group, but that there were increases of 32, 
42, and 71%, respectively, in the detection 
of objective defects in the Training, Visual- 
Aids, and Training-plus-Visual-Aids groups. 
The F ratio of 10.2 for differences among the 
four groups was significant beyond the .001 
level. “Before” and “after” comparisons 
within groups revealed that the increase in 
the Training group was significant at the .05 
level, and those in the Visual-Aids and Train- 
ing-plus-Visual-Aids Soups were significant at 
the .01 level. Thus, the experimental treat- 
ments clearly resulted in significant gains in 
detection of objective defects, 

Analysis of difference scores revealed that 
improvement in the performance of the Train- 
ing group did not differ significantly from that 
of the Visual-Aids group. It also revealed 
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that improvement of the Training-plus-Visuet 
Aids group was significantly greater (р < - d 
than that of the Training group, but not Es 
nificantly different from that of the d 
Aids group. Thus, the data suggest that il 
visual aids may have contributed more eod 
to the improved performance of the Combin 
tion group than did the training. VER 
It should be noted that the initial ге 
formance levels of the four groups in | us 
study were similar to those noted in ge a 
studies of machined-parts inspection. Та d 
and Tiffin (1945) reported accuracies 0 ues 
66% for 20 different measurement bom 
These and other findings strongly SUBE 
that stated accuracies for many pe 
spection techniques have been establis der 
under “ideal” conditions, rather than b 
those of the typical working environs. 
Thus, while the initial levels reported in rep- 
study may appear low, they probably ee 5 
resentative of those achieved by mu 
parts inspectors under normal working and, 
ditions. The final levels, on the other p 
reveal how significant improvements in little 


formance can be effected at relatively 
cost. 


Subjective Detections 


| va 

No significant changes occurred in e 
tive defect detection performance. O 
ranged from а 3% decrease to a 7% incre tely 
the overall level remained at ae 
50% detection of subjective defects. oup? 
ratio of 1.02 for differences among the 8" 
ше significant, 

his finding is not surprising, ids 

both the training program sat the sates ‘of 
were designed solely to improve detent te 
objective defects, Previous studies COPY" hat 
at Autonetics have indicated, howeVe сап 
Subjective defect detection performance 
be significantly improved by provide ig 
Spectors with photographs of items СОП nished 
such defects; no photographs were m 
in this study. 


because 


False Detections 


r4 
noe 
Еа > amo 
No significant differences were noted ай ts 


the four groups in numbers of E po 
reported. Changes ranged from a 1% 


>] 
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(о ап 8% increase; the Р ratio of 2.19 failed 

ume. significance. Thus, the gains in 

Bee ie detection performance apparently 

as ol tained without a corresponding in- 
е in false detections. 


Inspection Time 


maa Sinificant differences were obtained in 

to 15.3 o times. The times ranged from 104 

Шаг заана, the uio of 007 failed 

Ras Lee Significance (Ёш; = 3.08). The 

therefore objective detection performance, 

increase | were obtained without significant 
In inspection time and cost. 


CONCLUSIONS 


"i. M findings demonstrate clearly that in- 
Siving į Performance can be improved by 
еж ыы a short training program 
through to correct deficiencies identified 
Utes 52 Use of objective performance meas- 
taine d d also Show that gains can be ob- 
drawin y providing inspectors with simplified 
х 85 which show clearly the character- 


'Sticg : 
9 be inspected and the tolerances for 
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each. Furthermore, they reveal that even 
greater gains can be effected by utilizing both 
the training and the visual aids. 

Finally, they highlight the fact that in- 
dustrial/experimental psychologists can make 
significant contributions to the solution of in- 
spection problems. Furthermore, the benefits 
to the company can be measured in dollar 
terms; in a 2-yr. period an investment of 
approximately $50,000 in research in this area 
yielded a return of over $200,000 per year in 
documented cost savings (Thresh & Frerichs, 
1966). It seems safe to assume that the same 
kinds of results could be achieved in other 
organizations. 
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AFFECT LEVEL, CAPILLARY PULSE PRESSURE, 
AND RESPONSE LATENCY 
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xperiment was conducted in which the effects of the interest value of 
an ош pulis rate, capillary pulse pressure, and overt evaluation n 
latencies were examined. А group of 12 Ss evaluated 20 4-letter wor is i 
terms of an interesting-dull dimension under both visual and ei 
presentation conditions while the 3 measures of interest were simultaneously 
and continuously recorded. The results indicated no relationship between pulse 
rate and interest level, but significant functional relationships between both 
capillary pulse pressure and overt response latencies and levels of interest. 
These results substantiated the findings for the latter 2 measures demonstrated 
in an earlier study which employed pictorial stimuli and a pleasant-unpleasant 
overt response dimension. The relationships were demonstrated to be un- 
affected by presentation conditions, and it was concluded that capillary pulse 


pressure and overt response latencies may discriminate among 


levels over a broad range of conditions. 


Attempts to relate affective states of the 
individual to objective measures of these 
states have yielded mixed and sometimes con- 
tradictory results. In a comprehensive sum- 
mary of these results, Cook and Selltiz (1964) 
have concluded that where physiological 
measures are concerned, “Most measures of 
physiological reaction give direct indications 
only of the extent of arousal; they do not 
reveal whether the corresponding emotion is 
pleasurable or unpleasurable [p. 53]." The 
results of a recent study (Bergum & Lehr, 
1966), however, indicate that the affective 
value of pictorial stimuli, as judged by sub- 
jects (Ss) along a pleasant-unpleasant con- 
tinuum, can be reliably discriminated in terms 
both of capillary pulse pressure and overt 
response latencies as well as in terms of pulse 
rate and pupil size. In this study, colored 
photographic stimuli were evaluated on a 5- 


point scale by means of а key! 


board response 
device, 


from which the latencies of these 
evaluative responses were derived, while GSR, 
capillary pulse pressure, pulse rate, and 
pupillary dilation were simultaneously and 
continuously recorded. The results indicated 
that capillary pulse pressure and pulse rate 
tended to increase significantly with pleasant 
stimulation and to decrease with unpleasant 
stimulation, while response latencies tended to 
decrease significantly with pleasant stimula- 
tion and increase with unpleasant stimulation. 


general affect 


m ifi- 
Pupil size was demonstrated to be iasant 
cantly related to affect value, with P un- 
stimuli yielding pupillary dilation raction- 
pleasant stimuli yielding pupillary contr trate 
The latter results have been paw 
by other researchers (Hess & Polt, ssure; 
but the results for capillary pulse d 
pulse rate, and response latencies pee the 
be unique in this area, and the purpose Jicate 
present study was to attempt to dup con- 
these results under altered presentat el 9 
ditions, employing both a different ert 1€ 
stimulation and a slightly different d 
sponse dimension. Specifically, the ste ctotial 
this study were verbal, rather than P! words 
and consisted of four-letter English ffective 
ranging from relatively positively sr such 
terms such as номе and DEAR ne SLUT 
relatively negatively affective terms а which 
and DEAD. To determine the extent e» by 
the response measures might be affec Jaye 
stimulus mode, these terms were TT ation 
under both visual and auditory pom was 
conditions, and in addition, because t " 
some indication from the subsequent we! 
ments of Ss in the first study that ШО, са 
responding as much in terms of inte in 
they were in terms of pleasantness; an 
teresting-dull rather than the puer m 
pleasant overt response dimension walete! 
ployed. These specific references Осе d 
were primarily the basis for selecti? 
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RESPONSE LATENCY 


Em than such alternative dimensions as 
avorable-unfavorable, for example. 


METHOD 


v dinis Twelve females, ranging in age from 20 
clude an served as Ss in this study. The sample in- 
ried oth college and high school graduates, mar- 
4 and unmarried women. 
ing aes The apparatus employed in this study 
sponse "m rear-projection chamber, a five-key re- 
anborn eyboard, a six-channel event recorder, 2 
Corder single-channel continuous paper tape re- 
Stereo ' à pair of stereo headphones, and а Robertson 
h Sound tape recorder. 
Жоо eee chamber was a closed, sound- 
i | Pack box, 18 in. high, 16 in. wide, and 
end aid with an opening and chin rest at one 
Screen at ds 12-in.-square frosted-glass projection 
а table д hr other. This chamber was mounted on 
directly g the overt response keyboard was located 
table, The the right side of the chamber on the 
detent kes keyboard consisted of five microswitch 
Across, ee arranged in an are approximately 4 in. 
finger р ошаш to the general configuration of the 
tates 5 of the right hand. А 
vials and conditions. A total of 41 two-n- 


Squar 
i inp a and white slides were employed. One 


s ks control word, ROCK, presented in white 
Maining E medium-gray background, and the re- 
Words pr О slides consisted of four-letter stimulus 
аброс сетей in white letters on а medium-gray 
КЕ nd. The 20 stimulus words ranged from 
NU m as Home and pear, to such terms as 
two lists АСНЕ, These 20 words were separated into 
With а of 10 words each and each slide was paired 
"ange pea, slide. The pairs of slides were ar 
In addi Six different random orders for each list. 
Conto; tion to the slide materials, all stimulus and 
D th e materials were recorded on stereo sound tape 
ployed te order and time relationships as those 
9t all Or the visual materials. The instructions 
"Abe, conditions were also prerecorded on audio 


, Two 
Piton Presentation mode conditions, visual and 
th con Were employed, with all Ss serving under 
aide 06. The Ss were required to fixate on 
won, © throughout the auditory presentation con- 
ч-н Presentation mode conditions, lists, and 
Tee) and Sequences were counterbalanced actoss 
“Civeg S, 9XCept for this counterbalancing, all 5s 
Fac : entical treatment. 
чыры and experimental stimulus was pre- 
Daip Sec | Period of 10 sec., thus requiring a period 
к * for presentation of both members of the 
the end of the first presentation mode 
bei Slax ткн: visual or auditory, S was allowed 
ing? mag, few minutes while the changeover Was 
ct * for the next condition. The S was then 
Second a recording regarding the procedures 
Part of the experiment. 


ti 10; 
© ОА 
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The general procedure consisted of first present- 
ing the control stimulus of a pair, followed by 
presentation of the experimental stimulus, with S 
performing an overt evaluation response only during 
the presentation interval for the experimental stim- 
ulus. This response was made in terms of a 5-point 
scale lying along an interesting-dull dimension 
ranging from very interesting through very dull. 
Pulse rate and capillary pulse pressure were con- 
tinuously recorded throughout the experimental ses- 
sion as were overt responses and response latencies. 


RESULTS 


The overt evaluation responses served as 
the criteria for evaluating the three measures 
of primary interest. In the case of each meas- 
ure, the data associated with one interesting, 
one neutral, and one dull randomly selected 
overt response, in both the visual and auditory 
conditions, served as the raw scores for the 
analyses. The results of the analyses for each 
of the three measures are presented separately. 

Pulse rate. This measure consisted of the 
differences in pulse rate observed between 
the control and experimental slide presenta- 
tions of the stimuli, with a constant added to 
avoid the use of negative numbers. The data 
thus consisted of relative rather than ab- 
solute values of pulse-rate differences. 

The mean pulse rates for the three levels 
of interest category were 2.96 for the in- 
teresting category, 3.08 for the neutral cate- 
gory, and 3.00 for the dull category, suggest- 
ing no systematic relationship between this 
measure and the interesting-dull dimension. 
А repeated-measures analysis of variance was 
performed on these data in which the effects 
of presentation conditions, interest level, and 
Ss were compared. 


TABLE 1 
ANALYSIS OF VARIANCE FOR PULSE RATE 
Source SS df MS F 

Condition (C) 1 1 1.00 = 
Affect (A) 0 2 === M 
Subjects (Ss) ү 11 1.00 == 
АХС 1 2 50 1.22 
А X 55 19 22 86 2.10* 
Сх 55 16 11 1.45 3.54** 

Second order 9 22 41 

*p«.05 

ажр <.01 


05 - Жы 
Interesting Neutral Dall 


Overt Response Category 


Fic. 1. Mean capillary pulse Pressure in millimeters of 
deflection as a function of overt response category. 


The results of this analysis are presented in 
Table 1. None of the main effects was 
significant in this analysis, The interaction 
between Ss and interest levels was significant 
(F = 2.10, 22 and 22 df, p< 05) as was 
that between Ss and conditions (F = 3.54, 11 
and 22 df, р < 01). In general, these results 
are dissimilar to those demonstrated in the 
earlier study in which pulse rate was shown to 
be systematically related to categories of 
pleasantness. 

Capillary pulse Pressure. For this measure, 
the raw data consisted of the mean capillary 
pulse pressure observed for each stimulus 
presentation expressed as a percentage of the 
mean capillary pulse Pressure observed for 
each accompanying control slide presentation, 

The mean capillary pulse Pressures for the 
three categories of interest are shown in Fig- 


TABLE 2 
ANALYSIS OF VARIANCE FOR PULSE Pressure 


Source SS df | MS F 
Condition (C) 1 1 100| — 
Affect (A) 424 2 | 212.00 | 3.48* 
Subjects (Ss) 408 | 11 37.09 | — 
AXC 84 2 42.00) — 
A X Ss 850 | 22 | 38.64] _ 
Сх 55 605 | 11 | 55.00 

Second order 1,928 | 22 87.64 
Pooled error term for 

main treatment ef- 

forts 3,467 | 57 | 60.82 
жр <.05. 
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ure 1. For this measure, the stimuli вай 
as interesting yielded the highest mean E 
lary pulse pressures, with the an = 
dull stimuli yielding progressively lower Y 
pressures. Table 2 gives the results in {ог 
repeated-measures analysis of varianc the 
these data similar to that performed interest 
pulse-rate data. In this analy. 515, pu 
Category yielded the only significant highly 
(F = 3.48, 2 and 22 df, p < .01). € in the 
significant effect is similar to that foun eneral 
earlier study for this measure. The E Te 
magnitude of the effect is indicated a ps 
eta of .314 for this F. Direct-difference sig- 
between the three conditions indicate aa 
nificant differences between oie galerie 05, 
neutral conditions, #(11)= 2.435, ЁР andi- 
and between the interesting and gem 
tions, #(11)= 3.604, p < .01. The di as no 
between neutral and dull conditions verit 
significant, 1(11)= 0.310, р> .05, ар" re- 
Response latency. This measure Мет re- 
corded in terms of millimeters of or initia 
corder tape traversed from the point which an 
tion of the stimulus to the point at n were 
overt response was performed. The da п an 
then subjected to a log per pear raw 
these transformed data — 85 
Scores for the subsequent analysis. jes 
Figure 2 онан» the mean log p 
Plotted as a function of overt терше с 0 
gory. In general, response latencies арр as im 
be shortest for the stimuli evaluated roxi- 
teresting, and somewhat longer but apP 
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Moan Response Latency 


a 
a 


150 1 
Neutral e 
Overt Response Catego 


Interesting 


ату 
Š itra 
cies in arb ons? 
Fic. 2. Mean overt response laten 


= r 
Units of response tape as а function of overt 
category, 


Response LATENCY 


wd the same for the neutral and dull 
E A repeated-measures analysis of vari- 
E these data is given in Table 3. The 
н indicate that the effects of interest 
ped were highly significant (F — 8.42, 2 
pres dj, p< 01), as was the case for 
entation condition (F = 20.84, 1 and 22 
E 01). Tn the case of interest category, 

e eis of the relationship is indicated by 

i а = eta of .354. In addition, the 
Niani 1) between Ss were also highly sig- 
Beer 859, 11 and 22 df, р < 01). 
erest ] Шегепсез Ps between the three in- 
E ad indicated that the difference be- 
significa tits and neutral conditions was 
that berg (11)= 4.605, p < .01, as was 
tions cc the interesting and dull condi- 
ец 1) = 4.190, р < .01. The difference 
NOt signi the neutral and dull condition was 
resulte ificant, £(11) = 0.852, p > .05. These 
in qo We very similar to those demonstrated 
© earlier study where a pleasant-un- 


Pleas 
an 1 ; 
Ployeq.. Overt response dimension was em- 


DISCUSSION 


TOR Present results indicate that two of the 
Study objective measures employed in this 
Sbonse гарШагу pulse pressure and overt re- 
Чеге atencies, discriminate reliably between 
thing t levels of expressed interest, while the 
се asure, pulse rate, does not. With the 
duplicate Of the latter result, these findings 
Ш ап es almost exactly those demonstrated 
i vhi ee Het study (Bergum & Lehr, 1966) 
dime si а pleasant-unpleasant overt response 

‘on was employed and suggests a com- 
Dea, e derly ing mechanism for both the 


n i 4 
Mensiong Pleasant and interesting-dull di- 


results also suggest that the precise 
Menta) Stimulation does not alter the funda- 
Pressun relationship between capillary pulse 
What iu and overt response latencies and 
“Фргоа ‘ght be called positive and negative, 
«sti 2а and avoid, or affective categories 
оо vation, since in one study complex 
t e Pictorial stimuli were employed, while 

Second study simple verbal stimuli 

Ployed under both visual and auditory 
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TABLE 3 
ANALYSIS OF VARIANCE FOR RESPONSE LATENCY 
Source SS |df| MS F 
Condition (C) 5,992 | 1 | 5,992.00 | 21.09* 
Affect (A) 4,785 | 2 | 2,392.50] 8.42* 
Subjects (Ss) 11,224 | 11 | 1,020.36 | 3.59* 
AXC 983| 2 491.50] 1.79 
AX 55 4,310 | 22 | 195.91) — 
Сх 55 4,863 | 11 442.09 | 1.61 
Second order 6,039 | 22 | 274.50 
Pooled error term for 
main treatment 
effects 16,195 | 57 | 28112 
| *p <.01. 


presentation conditions. Thus it seems reason- 
able to eliminate stimulus complexity as an 
explanatory mechanism for the observed re- 
sults in these studies. 

The significantly longer latencies observed 
under the auditory presentation conditions 
(172.6 as opposed to 1544 for the visual) 
were to be anticipated simply as a function of 
the relatively longer transmission times re- 
quired for the auditory display of information 
as compared to its display in visual form. 

Because this experiment in a sense consti- 
tutes a replication of the earlier study, the 
results contribute considerably, both in a 
statistical and a heuristic sense, to the con- 
fidence that can be placed in the observed 
relationships and imply that these measures 
might profitably be employed in a broad 
range of situations involving a variety of 
affective stimulation of the kinds described 
by Cook and Selltiz (1964) in their summary 
of research on attitude measurement. 
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i idence has indicated that work values play an important role in 
wee ob e um and job satisfaction and begin to stabilize in а 
This questionnaire study further investigated the relationship between family- 
background characteristics and expected work values for college undergraduates. 
Different, distinct, family-background patterns, e.g., including family income, 
number of times moved, emphasis on discipline, emphasis on material things, 
closeness of family, etc., existed for those youths who stress humanitarian 
service (helping others); those who stress security and pleasant associations 


and working conditions; those who em 
dependence; those who stress creativit 


benefits. 


The family has long been recognized as an 
important factor in vocational development. 
In a study of work adjustment, it was con- 
cluded that people take their early experiences 
and attitudes with them on their jobs and 
react to their work accordingly (Friend & 
Haggard, 1948). Centers (1948) found sig- 
nificant differences in work values among per- 
sons from various social strata: the higher 
Broups emphasized the opportunity for self- 
expression and leadership; the lower groups 
Stressed security and the desire for independ- 
ence. Porter (1954) found the prestige level 
of the father's Occupation was related to 
vocational planning and preference of high 
School boys. MacArthur (1955) found sig- 
nificant differences in attitudes toward work 
between college students from upper- 
from middle-class homes, Work-value dif- 
ferences that have been shown between 
public- and private-school graduates may also 
be in part attributed to differences in orienta- 
tion in the family (Wilson, 1959). Further- 
more, these values toward work tend to stabil- 
ize in adolescence (Ginzberg, 
Axelrad, & Herma, 1951). 

Still needing further exploration 
is the question of which family-background 
characteristics are associated with which work 
values (Kluckhohn & Strodtbeck, 1961; Nor- 
ton & Kuhlen, 1950; Super, Crites, Hummel, 
Moser, Overstreet, & Warnath, 1957). To this 
end such a comparison was made to add to 


and 


Ginzburg, 


› however, 
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phasize prestige, responsibility, and in- 
У; and those who emphasize monetary 


? ice and 
the understanding of vocational choice 


job satisfaction. 


METHOD 


The data for this study were obtained ру ie 
of a questionnaire containing three pars. í 
Portance of work values, the perception Seni 
background characteristics, and general fa 
formation. ion an 

Work values were defined as the op jo 
individual has of the factors associated wit! ch hi 
which satisfy his needs and help him Fenit 
goals. Nine work factors were used: job iss an 
physical working conditions, social needs (c = - 
Dleasant associations with fellow workers Es degree 
Portunity to help others), job prestige, Piit ac 
of responsibility, Opportunity for indepen things 
tion, opportunity to invent or design new aploye? 
or ideas, and monetary compensation and T en yo 
benefits, The respondents were asked, p the 
begin Working, how important do PAL o: each 
following characteristics will be to you? answer 
of the work values they were instructed to tending 
by circling a number on a rating scale €% t low 
Írom 1 to 7, where “low numbers represe” cont 
or minimum amounts and high numbers PR 
high or maximum amounts." r 

Similarly, the respondents were asked m 
à 7-point scale the amount of certain pui р 
ground factors perceived to be present in 
bringing, that is, 


amily- 


› 


P pov 
how close were the members of your s] your 
much discipline were you subject to EET as 
youth, how many close friends did you age У 
a child, how much did your family eae p to 
to be independent, and during your У empha” 
what degree were the following factors interest 
sized in your home: religion, cultural e» 
materialistic things, community activities (datin® 
Scouts, youth groups, etc.), social activities 
Parties, etc.) . 


чу 


et 
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TABLE 1 
SIGNIFICANT CORRELATIONS BETWEEN WORK VALUES AND FAMILY BACKGROUND 
Work values 
Family 
аны Physical PESE. ны Responsi-| Inde Monetar 
i n iati sti onsi- E fiiy опеїагу 
Security working oth fellow others | Prestige bility | pendence | Creativity benches. 
a conditions workers 
‘Oseness 
N A EM = = .15* — —.15* 
Dis 1998 friends dee dee diee — = AT — Ta a 
Gal activities sore | 290 | de | uam Jove | ae as 23 SES 
ЧУ + —a7* тк 
Religi 20** + aie = 225* 24 AT л9 
део .20** а= TR = — = — Ope 
Culture e 17 3t ive = 
Material things = ae ee 21e 1e gail = = 15% 
arital status of — 308 = 
чатр - 
. children i = = T 
family ren in _ 
O. tim, = = = =a 
Чыра _ =, = a рны | 2 |a 
Мое. у 
ы = 14 
=? X05, r > 137 
P <.01,› > 1192, 
S001, 7 > 269. 
Ge " 
Com, = information was gathered on family in- Tur ENVIRONMENTALIST 
im) hum . : ; . M 
ы е den “шел: Шау, бо sume a A pattern of six moderate positive (.20-.32) 
a stai E 3 à 
ти, ОРКЕ НЫШЫ correlations and the one negative correlation 
e А А à М 
Univers tionnaire was administered to 15$ male existed for the security need. As might be 
Mostly Of Maryland undergraduates. They were ух hose respondents who indicated a 
ey. fresh g expected, pon 
pes Section GE 289 eee and vá relatively low family income tended to place 
аг: > major tments and schools. a : H H 
to ieee correlation ie program was used а high emphasis on the scu value. 
Usable ee compare the relationships from 14$ This supports the Centers’ study (although 
Nestionnaires, his sample was made up of people in their 
working years). : | 
Tab RESULTS Furthermore, the most effective combina- 
«able T nos : Pk E ү 
tions 1 indicates the significant correla- tion for predicting. security emphasis would 


бод ee work values and family-back- 
With at actors. Each work value is associated 
ау. least two or up to seven perceived 
hoy, Ackground factors. The correlations, 
"Sua T, though statistically significant, are 
e tan ОТ moderate. 

tain р lable also indicates the pattern of cer- 
Socia] “8tound factors. For example, family 
"lations tities has moderate positive Cor- 
abeng with prestige, responsibility, and 
the thes E The number of times moved, on 
© sam and, has negative correlations with 
sitive е Values, Family income shows one 
Correlation (.21 with monetary bene- 
есте negative correlation (—-22 with 
elatio y need). Moreover, the grouping of 
lagi n es indicates various family-back- 
ion, “terns relating to various job orien- 


M 
Bro 


also include those who indicate a close family 
relationship with discipline, social activities, 
community activities, and religion emphasized, 
and a number of close friends seen as existent. 
This type of family perhaps “makes up” for 
lack of income by imbuing a social-religious 
security which affects the developmental 
process of work values. 

The pattern of responses for the physical- 
working-conditions factor was similar to that 
for security with two exceptions; ones that 
might be expected: An emphasis on material 
things in the home associated with the im- 
portance of pleasant working conditions; 
whereas no significant correlation existed be- 
tween religious emphasis and pleasant work- 
ing conditions. 

The social need for close association with 
others on the job also follows a similar pat- 
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tern of correlation with background factors 
with the exception of the income item (where 
no significant correlation exists). The york 
group thus may provide important security 
and camaraderie for a person with a family 
background as indicated. bb unns 

Moreover, speculation on this similarity in 
the three patterns of family-background re- 
sponses for those who value security, pleasant 
working conditions, and associations might in- 
dicate an “environmentalist” type of voca- 
tional development, that is, one who empha- 
sizes a pleasant, secure environment, 


THE HUMANITARIAN 


Another social need (helping others) shows 
a different pattern and it is more difficult to 
predict with only two significant correlations 
with family background. The highest cor- 
relation (.24) is with perceived emphasis on 
culture in the home. The other correlation, a 
relatively low one (.17), is with social ac- 
tivities emphasis. These results may seem 
hard to explain; one might expect, for ex- 
ample, for religion (or other factors not 
measured) to enter in. Perhaps, however, the 
cultural stimulation was developed with con- 
genial interpersonal relations, both inside and 
outside the home, and an “other awareness" 
developed. Thus, one might surmise the 
"humanitarian" vocational outlook for youths 
of this background. 


THE CLIMBER 


The work values of prestige, responsibility, 
and independence indicate similar relation- 
ships with several family-background factors, 
that is, emphasis on social activities, in 
dependence, and culture, and the number of 
times the family moved. In addition, prestige 
alone (of the three) was correlated (.39) with 
the emphasis on material things. Also, prestige 
and responsibility associated with community 
activities. 

From this sample, it can be Speculated that 
the amount of prestige desired by one select- 
ing a vocation is a function of the extent he 
was encouraged to participate in social ac- 
tivities and the emphasis on materia] things 
in his home life. Similarly, the evidence sug- 
gests that the youth who has been brought 


Е. T. Pame, D. К. Deutscu, AND В. A. SMITH 


up in a family where culture, independ 
and social activities have been emphasi ES 
would tend to explore vocations where a 
sponsibility and independent action pees 
quisites. On the other hand, frequent i wi 
relocations during youth are associated Т 
less emphasis on job prestige, respons! 
and independence. Р 
Thus, the somewhat similar family 
ground patterns for those who stress oí 
three work values might indicate the P in 
and exploratory stage for the voca 
“climber.” 


-back- 
these 


THE CREATOR 


" ffect 

No support existed for the poiible 1e 

of income (social strata) on aye in- 
(and independence) as the Centers’ 5 


А ar- 
dicated. In fact, the creativeness E nega" 
acteristic was associated only with lo f com- 


: evi" 
value creativity tend to be creative, this 
dence provides modest support f Ki 
studies (see Chambers, 1964; Mac d less 
1965; Scott, 1965) which have indicate’ yer 
discipline, less closeness to parents, a inter- 
rewards from family for community other 
action for creative individuals. On Devious 
hand, there was no support for the рї oving 
finding of a positive association of ™ 
about in childhood and creativity. 


THE MERCENARY 


as- 
Finally, the monetary job factor we iae 
sociated with several family-backgroun of 
tors. Most prominent was the amour ү, 
discipline with a moderate positive ie the 
Hon (.30); of lesser relationship W3 yy. 
amount of income and emphasis ? friends 
munity activities, the number of close singly? 
material things, and, perhaps surp та dis- 
religion. The materialistic, well-to- hasiz 
ciplined family which seems to ері, 
religion and aspire for close friends oni n 
its offspring toward a greater empha 
monetary compensation and benefits. though 
Results of this correlational study work 
do not warrant unlimited generalization- 


= 
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orientations no doubt are influenced by a 
араг of interacting factors in the family 
i Culture; more evidence is needed to check 

€ several patterns of development that are 
Suggested by the data. 
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MOTIVATIONAL EFFECTS OF KNOWLEDGE OF RESULTS: 
KNOWLEDGE OR GOAL SETTING? ? 


EDWIN A. LOCKE 
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on knowledge of results (KR) has generally not controlled for 
па effects resulting from differential goal setting. The present experi- 
ment was carried out to separate the effects of KR and goal setting using а 
2X2 fixed-model design; the variables were KR versus no КЕ; апа specific 
hard goals versus “do-best” goals. The goals (manipulated by instructions) же 
representative of the goals typically assigned (explicitly or implicitly) to К 
and No KR Ss in previous studies, respectively. No difference was found be- 
tween KR and No KR groups, but a significant goal effect was found in favor 
of Ss given specific hard goals. The results indicated that effects previously 
attributed to differential KR were actually due to different levels of motivation 


produced by the different goals. 


The positive influence of knowledge of re- 
sults (KR) on learning and performance is 
one of the best established findings in the re- 
search literature (Ammons, 1956; Bilodeau 
& Bilodeau, 1961, etc.). Research on KR. has 
not been overly concerned with theoretical 
issues, but the fact that occasional studies 
fail to find significant KR effects on perform- 
ance (e.g, Chapanis, 1964) emphasizes the 
need to integrate and systematize findings in 
this area. 

Several investigators (e.g., Vroom, 1964) 
have distinguished between the in formation or 
cueing function of KR and the motivational 
function. The former refers to information 
given to Ss regarding the nature and locus 
of errors and the nature of the correct 
response (epistemic KR). Most studies of 
KR or "feedback" have been of this type 
(e.g., Bilodeau & Bilodeau, 1961). Given a 
constant motivational state, the more informa- 
tion given to S about the task or about how 
to correct errors, the better his performance 
level or learning. 

The manner in which knowledge functions 
to motivate S is much more complicated. One 
possible means of isolating the motiva- 
tional effect of KR is to give S knowl- 


1This research was supported by contract Non 
4792(00) between the Office of Naval Research and 
the American Institutes for Research. The author 
would like to thank Judith Bryan of AIR for 
analyzing the data for this study and Charles D, 
Spielberger of Florida State University for his many 
helpful comments on this paper. 
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ing errors 
edge that cannot be used for correcting 


e 
or for changing the timing or locus of нк yn 
sponse. Examples of KR that do not sud be: 
to a better method of performing wou task 
total time-on-target on a pursuit rotor uta- 
total score after several trials on a d 0 
tion task; total score after several шш ә 
a dart-throwing task. Knowledge of vies and 
Simple motor tasks such as reaction tim dif 
weight lifting also falls into this et 
since there are no right or wrong respons е 0 
such tasks. Any effects on performance mo- 
this type of KR may be attributed | S's 
tivational factors since presumably only 
level of effort is influenced. " 

In the "classic" studies dealing es 
tivational KR such as those of m 
Norvell (1922), Crawley (1926), Mac 18 
(1950), and Ross (1927), Ss given knov 
of score were usually told to try to 0 goals 
their performance or were given explicit Ei 
to reach, whereas the No KR Ss were Ao cores 
to think about trying to improve ve » АГ 
or were told simply to *do their ре 
though the KR groups performed ecd 
the No KR groups in these experimen ‘with 
effects of goal setting were confounder g i 
the effects of knowledge of score, ma 


mo- 
and 
orth 


than 
e 


uld be 
? While it is true that scores of this Туре e od of 
taken as а cue or signal to change ones MY ated У, 
Performing the task ог to change one liit one 
such scores do not yield information about edi Jor 
did wrong or where the mistake(s) bw corre 
does such knowledge tell one what kinds 0 
tions to make. 
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РА to determine which was the critical 
үе le or the interdependence, if any, be- 
of ^ them. Similar criticisms can be made 
h-- studies, for example, Church and 
Chyli, i. McCormack, Binding, and 
MERE i (1962); McCormack, Binding, and 
bons (1963); and Payne and Hauty 
manipul Ti these studies goals were not 
aun ated explicitly, but KR was given 1n 
ous to standards (such as S’s best previ- 
go Score) which clearly must have suggested 

als to Ss. 
LA other studies (Arps, 1920; Gibbs & 
d p Johanson, 1922; Mace, 1955; 
or KR 935) positive results were obtained 
оаа, } without explicit manipulation of Ss 
ine m yos. no attempt was made to deter- 
o KR ifferent goals were set by KR and 
the е groups (although Mace argued that 
ect of KR was to suggest performance 
ards to the KR Ss). In contrast, Chapanis 
Ginn” attempting to replicate the finding of 
elim; ind Brown (1955), did two things to 
1962 i demand characteristics" - (Orne, 
Sults: ç at may have affected previous re- 
a job m he “hired” Ss as employees doing 
rather * pay (punching digits onto a tape) 
Tan Ss [m as experimental Ss; and (b) he 
Was the Widually rather than in groups (as 
this ar case in most previous experiments in 
sett; ©): In the absence of the implicit goal- 
erene gemands (e.g., improvement") in- 
and the the typical experimental situation 
tion C Dossible effects of implicit competi- 
forman apanis found no effect of KR on per- 
foung ce: Further, Locke and Bryan (1966) 
n ma Overall effect of KR on performance 
Vere ao computation task. But when Ss 
Perfo mas ped according to their a posteriori 
A Mina. goal descriptions, à significant 
foun Ship of goals to performance was 
haq Xin Uggesting that differences in Ss’ goals 
Y n on performance than differ- 


Stand, 


е 
Neeg in 


of кр "bove findings suggest that the effects 
ч al Should be separated from the effects 
KR i Setting in order to determine whether 
icaj, luences performance level automat- 
Rap t Whether its effects are mediated by 
i activity. The purpose of the 


Dreg, 
Se 
experiment was to test the hypothesis 
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that effects previously attributed to differ- 
ential KR were actually due to different per- 
formance goals associated with the different 
KR conditions. The major premise underlying 
this hypothesis is that level of effort on a task 
is determined largely by S's conscious per- 
formance goals. This emphasis on a cognitive 
approach to motivation is supported by recent 
theoretical developments (e.g., Dulany, 1962; 
Miller, Galanter, & Pribram, 1960; Ryan, 
1958 °; Spielberger, 1965) and by the findings 
of a number of recent studies (e.g., DeNike, 
1965; Dulany, 1962; Locke, 1966a, 1966b; 
Locke & Bryan, 1966a, 1966b; Spielberger, 
Berger, & Howard, 1963; Spielberger, Bern- 
stein, & Ratliff, 1966; Spielberger, Levin, & 
Shepard, 1962). 
METHOD 


Task 

The task was simple addition. Each problem con- 
sisted of three two-digit numbers and was presented 
on a separate 3X5 index card. The cards were 
placed consecutively in boxes holding 720 cards 
each. The Ss wrote their answers on sheets con- 
taining space for 90 answers. Аз each answer sheet 
was completed, S was instructed to insert it in а 
slot underneath a one-way mirror through which he 
was observed by E during the experiment. The S 
worked 1 hr. at the task, which was divided into 
five trials separated by short rest periods. The trials 
were alternately 10 and 15 min. in length (ї.е., 10; 
15; 10; 15^; and 10’). All Ss were told the length 


of each trial in advance. 


Subjects 

The Ss were 24 male and 12 female paid college 
(undergraduate) volunteers selected from a larger 
pool of 62 volunteers. All Ss in the original pool 
were given a pretest consisting of three 1-min. trials 
on the addition task and asked to make three at- 
titude ratings indicating their liking for and interest 
in “tasks like this.” From this pool, four matched 
groups of nine Ss each were selected as follows: four 
Ss were chosen who were approximately equal in 
ability and equal on the three attitude ratings; each 
of these Ss was then assigned at random to one of 
the four experimental conditions. This procedure 
was repeated until there were nine Ss in a cell. 
Thus the cells had almost identical means and dis- 
tributions on the four matching variables. No at- 
tempt was made to match for sex; but as it turned 


3Sce also unpublished mimeos, 1964. Chapter I: 
Explaining behavior; Chapter II: Explanatory con- 
cepts; Chapter V: Experiments on intention, task 
and set; Chapter VI: Intentional learning; Chapter 
VII: Unintentional learning. Cornell University, 
Department of Psychology. ` 
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out, the proportion of females to males was ap- 
proximately equal for the main effects. 


Design and Procedure 


The experiment was introduced as a study of the 
development of attitudes toward the task. The 
structure of the task was explained. The Ss were 
told not to spend a lot of time checking answers 
since the total number correct was more important 
than the percentage correct. While S worked, E 
stayed in the adjacent observation room. The S 
was made aware of the one-way mirror and was 
told E would remain there during each trial so as 
not to disturb S. Communication was possible 
through an intercom system. 

The design was a 2X2 fixed model. The fixed 
variables were knowledge of score (KR) and type 
of goal. 

KR condition. The KR Ss were told the number 
of problems they had gotten correct at the end of 
each trial. 

No KR condition. The No KR Ss were not given 
their scores. Since Ss had to hand in each answer 
sheet after completion and since they did not know 
how many of their answers were wrong, these Ss 
could not easily keep track of their scores. 

Do-Best goal. Do-Best Ss were told to do their 
best on each trial (This was the goal typically 
given to No KR Ss in the experiments discussed 
earlier. Do-Best Ss in the KR condition could not 
easily use their scores to set specific personal goals 
due to the alternating trial lengths. In addition, 
Do Best-KR Ss were not allowed to perform any 
computations between trials that might enable them 
to determine their rate per minute (a precondition 
for setting а goal such as "improvement?), 

Hard goal. Goals were set for the Hard-Goal Ss 
on the basis of the scores attained by the matched 
Do-Best Ss. On the first trial a given S's goal was 
set about 1076 higher than the score achieved on 
the same trial by a matched Do-Best S. Then E 
adjusted S's goal before each succeeding trial de- 
pending upon how well S had done on the previous 
trial. If S did not get near the goal, the next goal 
was lowered slightly; if S reached or exceeded the 
goal, the succeeding goal was raised. 

The goals were marked by means of a colored 
3X 5 index card placed vertically at the appropriate 
point in the box of problem cards. This card rep- 
resented the point they had to reach by the end of 
the trial in order to reach their goal (if they got all 
problems correct). The Ss were told to try and sur- 
pass this point since they were bound to get some 
wrong. They were told at the end of each trial 
whether or not they had beaten the goal but were 
not given their actual scores unless they were in 
the KR condition. 

On the average the goals of the Hard-Goal Ss 
were set from 0% to 32% (mean and median = 11%) 
above the scores attained by the matched Do-Best 
Ss. Hard-Goal Ss were actually able to reach or 
beat their goals on 16% of the trials. 
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The Ss had approximately 2 min. rest bem 
trials during which E corrected their pic d 
(if they were in the KR condition) and de re 
their new goals (if in the Hard-Goal cono ental 
To set the new goal, E came in the exped 
room and placed the colored card at the SED ПУ 
place in the card box. No Ss were told now they 
problems were needed to reach the goal, a where 
could get only a rough idea of this by seeing 
the colored card was placed in the card box. ked to 

At the end of the experiment Ss were d a 
look at a set of cards, each of which дө tried 
possible goal they could have had (e£ 1") and 
to do my best”; © I tried for the assigned £02 esente 
were asked to pick out the card that best xu 
their performance goal during the experiment. 


RESULTS 


е 
"Three different performance measures iy d 
used: (a) deterioration scores, defined 2: rob- 
difference between the mean number 0 retest 
lems correct per minute on the three P cor- 
trials and the mean number of Ва anial 
rect per minute during the five exper! d from 
trials; (b) linear slope scores calculate ute on 
the number of problems correct per min ) 
the five experimental trials only; P menta 

percentage of errors on the five exper 
trials. 

The performance curves for each 
mental subgroup, in terms of total P 


experi: 
roble 
i 
correct per minute, are shown graphical, y 
Figure 1.* It is evident that both ag po 
groups did progressively better than t them 
Best groups, the difference between eriod- 
reaching a peak in the last (10') trial Р. did 
On the other, the KR and No KR гаар i 
not diverge except for the Hard-Goal 8" 
the last 10-min. period. 5 (using 
The results of analyses of variance for the 
a standard 2 x 2 fixed-model design) п in 
three performance measures аге ane usin’ 
Table 1. The goal effect was significant "шу, 
both deterioration scores, F (1/32)= 


de- 
ed 
*]t is evident that, in general, SS oer rais 
terioration (rather than improvement) in eriment@ 
of performance from the pretest to the d рїї, 
trial. This can be attributed to two ew jod * 
little or no learning occurs over a shor! n. Sec? 
time with mature Ss on a task like additio ow one 
the slightest lapse in concentration will E: an some 
addition rate. Since over a longer time d a оет 
attention lapses are inevitable, this produce trials 
rate on the longer trials. The experimenta " y 
this case were 10-15 times as long aS 
1-min.) practice trials. 
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Hord Gool - КЁ(М'Ў) 


РУ 


8 


Hord боо!-Мә KR (№: 


Toral Problems Correct Per Mint 


Do Best -KR (N:9) 
Do Best - No КАМ: 


"WM dh dh da dà dn 
T Trial Period No. 

10. 1. Total problems correct by trial period for 

experimental subgroups. 
a 05, and linear slope scores, F (1/32)= 
> P< 01, with the Hard-Goal group 
Cases, omen to the Do-Best group in both 
ard-G, matched-groups test comparing the 
by ES and Do-Best groups (performed 
Best 8. ing each Hard-Goal S with а Do- 
tatio is equal initial ability) yielded a / 
02 mean deterioration of 2.80 (17, ? < 
Vielded A a similar test using slope scores 
o Gere of 3.18 (17, р < .01). There was 
formance effect of KR on any of the per- 
3 ШС measures, nor was there evidence of 
Oa], eraction between KR and type of 


being 


E were no significant main effects nor 
terion fraction for the percent error cri- 
> Indicating that the higher perform- 
A e attained by the Hard-Goal group 
Beate, achieved at the expense of a relatively 
lems ie of errors in relation to prob- 
Best, e mpted. Both the Hard-Goal and Do- 
ч фы averaged about 5.676 errors dur- 
‚ the experimental trials. 
tionin results of the postexperimental ques- 
cithe g indicated that all Hard-Goal Ss were 
them ving explicitly for the goals ОГ had 
a [с mind as they worked along. Eleven 
do thei O-Best Ss said they were trying (o 
е а. best”; four said they were (118 
5 Es at = ‹ 
of “Ported 


‘reasonably fast pace"; two tried 
‘normal” or “slow” расе; and one 
that he tried to complete one box 
бош, Th Droblem cards by the end of the 
‘est че Jatter S was the only 5 in the Do- 
ur т dition who worked at a faster Pac? 

ms of problems correct Per minute) 
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during the experimental than during the 
three pretest trials. 


Discussion 


The results of the present experiment sup- 
port the hypothesis that motivational effects 
previously attributed to differential KR were 
actually a function of differential performance 
goals associated with the KR conditions. 
When differential goal setting by KR and No 
KR Ss was controlled, no overall effect of 
KR on performance was found. However, 
when the effects of the goals typically set by 
KR and No KR Ss in previous experiments 
(e.g., specific hard goals versus do best) were 
compared, a significant goal effect was found. 
These results were consistent with previous 
findings by Locke and Bryan (1966b) where 
goals were measured by postexperimental 
interviews rather than manipulated by in- 
structions. 

Although the findings of the present study 
provide support for the initial hypothesis, 
there are a number of issues still open. It may 
be observed from Figure 1 that there was an 
effect of KR condition between Trials 4 and 5. 
The KR groups increased their performance 
rate on Trial 5, whereas the No KR groups 
decreased. The F for the difference scores 


TABLE 1 


ANALYSIS OF VARIANCE RESULTS FOR THREE 
PERFORMANCE CRITERIA 


Source Е 
Deterioration 
Goals 4.83* 
KR «1 
Goals X KR <1 
Within (MS) (8,695.28) 


Linear slope (Trials 1-5) 


Goals 12.87% 
KR 1.36 
Goals X KR <1 
Within (М5) (797.78) 
Percentage of errors (no. wrong/no. 
attempted) 

Goals <1 
ЕЕ 1.32 
Goals X КК <1 
Within (MS) (9.20 


Note.—df = 1/32. 
жр <.05. 
wp < .01. 
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(1/32) was 8.83 (p < 01). It would be 
useful to determine whether this effect was 
due to implicit goal setting on the part of the 
KR Ss, who by this time may have been 
able to get some idea of their rate, or to some 
other effect. : 

Only two goal classes were used in the 
present study. In one sense the hard goals in 
the present experiment were harder than the 
do-best goals, since the hard goals were set 
above the performance level of the Do-Best 
Ss. However, just “how much" harder is not 
known. A greater variety of performance goals 
should be utilized in subsequent studies and 
some attempts made to scale the goals as to 
difficulty or motivational level. 

In more general terms, the results of the 
present study suggest one mechanism by 
which incentives of all types might work (e.g., 
KR, money, instructions, participation, praise, 
reproof, verbal “reinforcement,” etc.); it is 
possible that such incentives are e 
to the degree that they affect 
intentions. Research in the area of verbal 
learning (DeNike, 1965; Dulany, 1962; 
Spielberger et al., 1962) suggests that a verbal 
reinforcement (given that the response-rein- 
forcement contingency is known) is effective 
in changing behavior to the precise extent 
that S desires or intends to get the reinforce- 
ment. In view of the seemingly inconsistent 
and often unpredictable effects of incentives 
on performance, it seems probable that the 
use of goals and intentions as mediating vari- 
ables will be necessary if fully adequate ex- 
planations of the effects of incentives are to 
be achieved. 

The present results Suggest that in order 
to predict the effect of knowledge of score 
on performance level, it is not enough to know 
that the individual has such knowledge. It is 
also necessary to know what he does with it, 
that is, how he evaluates it and what goals he 
sets in response to it. 


ffective only 
S’s goals or 
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THE HERZBERG THEORY: 
A CRITIQUE AND REFORMULATION 


CARL A. LINDSAY;! EDMOND MARKS,? ax» LEON GORLOW 


Pennsylvania State University 


The Herzberg "Theory of job satisfaction, 
first published in 1959 (Herzberg, Mausner, 
& Snyderman, 1959), and amplified and ex- 
tended by Herzberg ( 1962, 1964; Herzberg 
& Hamlin, 1961, 1963), represents an ap- 
proach to an understanding of the motivation 
to work. In the original ( 1959) study, the 
investigators concluded that the determinants 
of job satisfaction, motivators, are different 
from the determinants of job dissatisfaction, 
hygienes, Motivators which are job-content 
variables are called such to emphasize their 
role in satisfying the Worker's need for self- 
actualization. Job-context variables are labeled 
hygienes to indicate their role in preventing 
job dissatisfaction, Herzberg et al, (1959) 
further concluded that motivators affect job 
attitudes in a positive direction, and “their 
absence will much less frequently lead to job 


1This study is based on 
dissertation by the senior author submitted to the 
graduate school of The Pennsylvania State Uni- 
versity in partial fulfillment of the requirements for 
the PhD. 

? Now at the Office of Evaluati 
Institute of Technology, Atlanta. 


à portion of a doctora] 


lon Studies, Georgia 


+, lar 

job satisfaction is made up of two unipo 
traits [p. 3].» d ther 

By now the theory has ee (cf. 
Widespread attention in the litera stt ies): 
Burke, 1966, for a review of 14 earch і 
However, an examination of the res deriv 
Which the theory itself, or hypothese. С re- 
from it, was investigated, shows wo h 
Sults and conclusions. Studies in "d to col- 
basic Herzberg methodology was use hold the 
lect and analyze the data typically "P nusaitis 
theory, for example, Schwartz, Je Myers 
and Stark (1963), Saleh (1964), атыса Dut 
(1964). On the other hand, studies W jestion" 
Job factors into а structured format (Р lysis 
naire) and use techniques for data Ps Fried- 
such as factor analysis (Ewen, 196 ‘correla 
lander, 1963), comparison of means, landet: 
tion analyses, variance analyses ar Wern 
1964; Gordon, 1965; Halpern, 196 '(Вш®® 
mont, 1966), or a scaling techno not 5 
1966), either do not support the ein it 
stated, or at best give equivocal supp substa?" 
In sum, the theory has been both 
tiated and refuted in part. { the am 

It seems apparent that part 0 „ theory 
biguity Surrounding the Herzberg ical 19. 
might be attributable to methodolos nd 
consistencies and the lack of a for ation 
logically consistent statement of wi 
among the variables of interest. to: a) 
the present study was undertaken rg eth 
critically examine the basic Herzbe ment 0 
odology, (5) attempt a formal state 
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the theory, and (c) advance and test a bipolar 

del of job satisfaction based on a modifica- 

din of the Herzberg theory. A detailed ex- 

нш of methodologies other than the 

ты d nployed by Herzberg et al. (1959), and 

Sal Subsequently by Schwartz et al. (1963), 
eh (1964), and Myers (1964), is beyond 
€ Scope of this paper. 


Examination of the Herzberg Methodology 


ae basic Herzberg method of collecting 
jects nalyzing data involves providing sub- 
(Ss) with two sets regarding their job 
im амаа, First they are asked to recall a 
either 7 their job tenure when they were 
$ xs satisfied or (D) dissatisfied. Then 
cidents) anda to discuss these events (in- 
tributeq and to specify the factors which con- 
exper to their satisfaction-dissatisfaction 
ences, 

- the original study (Herzberg et al., 
› 16 job-factor categories were identified 
two 8^ content analysis and collapsed into 
Bier teal categories, motivators and Ay- 
among OX the basis of logical relationships 
Motivate categories. Relationships between 
званар 5, hygienes, and job satisfaction- 

inin action? were hypothesized by ex- 
Were 5 the frequency with which motivators 

Bene ciated with job satisfaction, and 

peg job dissatisfaction. | Р 
іса] шс methodology, essentially а crit- 
for „cident interview, is sübject to criticism 
сопор Olowing reasons: (а) it does not 


s inci from 
lven $ er the number of incidents 


tione d wi 


throu 


› Or the number of job factors men- 
the ro} th a given incident; (b) it reverses 
забе. 5 Of the dependent (satisfaction-dis- 
and action) and independent (motivators 
mt vun cues) variables by setting the depend- 
and а ables at one of two levels (high-low) 
Череп Wing what are conceptually the in- 
the gx Cnt variables to vary as a function of 
the 5 Tesponses; and (c) it does not look at 


or А 
factio the remainder of this article, the term satis- 


n. : 
RM dissatisfaction will be employed when the 
ОШ Tefers to Herzberg’s use of two unipolar 
° the (3 2nd satisfaction employed singly will refer 


tional bipolar concept of satisfaction. 
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is, the theory does not specify a functional 
relationship between the variables of interest; 
and (d) it does not provide for examination 
of higher degree (interaction) effects between 
these two classes of variables (motivators and 
hygienes) as they relate to satisfaction. 


A Formal Statement of the Theory 


Herzberg’s major hypothesis is that satis- 
faction-dissatisfaction (S-DS) is a function 
of the classes of motivators (M) and hygienes 
(Н). Further, Herzberg goes on from his 
major hypotheses “. . . that the factors lead- 
ing to positive attitudes and those leading to 
negative attitudes would differ [Herzberg et 
al., 1959, p. 29],” to state at a later point: 


This hypothesis [the two-factor motivator-hygiene 
hypothesis] suggested that the factors involved in 
producing job satisfaction were separate and distinct 
from the factors that led to job dissatisfaction. Since 
separate factors needed to be considered depending 
on whether job satisfaction or job dissatisfaction was 
involved, it followed that these two feelings were 
not the obverse of each other. The opposite of job 
satisfaction would not be job dissatisfaction, but 
rather ло job satisfaction; and similarly the opposite 
of job dissatisfaction is no job dissatisfaction—not 
job satisfaction. The fact that job satisfaction is 
made up of two unipolar traits is not a unique oc- 
currence [Herzberg, 1964, p. 3]. 


The above assertions imply the following 
functional relationships between job satisfac- 
tion-dissatisfaction and motivators and hy- 
gienes: 


S=f(M+e) [1] 
DS = f(H + e) [2] 
p(M,H)= 0 [3] 


That is, satisfaction (S) is a function of 
motivators (M) plus other potential factors 
and/or error of measurement [1]; dissatis- 
faction (DS) is a function of hygienes (H) 
plus other potential factors and/or error of 
measurement [2]; and the correlation (p) be- 
tween motivators and hygienes is zero [3]. 
Conceptually then, Herzberg posits two 
unipolar continua (satisfaction, dissatisfac- 
tion) which are unrelated and states that the 
variance in satisfaction is due to the presence 
and/or level of motivators, and the variance 
in dissatisfaction is due to the presence and/or 
level of hygienes. Expressions [1] through [3] 
above are formal statements of the relations 
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among the variables of interest as treated by 
the theory on a conceptual level. 


Modification of the Theory 


Rationale. The rationale for the adoption of 
the model of job satisfaction tested by the 
present research is based on a consideration of 
the research strategies employed by Herzberg 
and other investigators, and the assumption 
that satisfaction is more parsimoniously con- 
ceptualized as a bipolar variable. . 

Using the bipolar assumption, it is sug- 
gested that by examining only the extremes 
of the underlying continuum of satisfaction 
through the use of instructional sets (satisfied- 
dissatisfied), Herzberg and other investigators 
using his methodology have concluded that 
motivators and hygienes are disjoint, and that 
satisfaction and dissatisfaction should be con- 
ceptualized as two separate continua. 

If the Herzbergian conclusions are formal- 
ized and translated into a bipolar model of job 


satisfaction, the following conditions would 
obtain: 


For high job satisfaction (Sa) 


S. = f(aM + bH), [4] 
for high job dissatisfaction (S_), 
8. == f(aH + bM) [5] 
where a is some 


Positive coefficient and b 


equals zero, and M and H are as defined 


previously. 


Expressions [4] and [5] 
what is implied by Herzbe 
for satisfaction, namely, 
satisfaction to a given ant 


hygiene) is not independent of the other 


clearly indicate 


t for the weight 
uired to change 
other antecedent 


In view of this rationale, 
decided to adopt and test 
satisfaction in which job satisfaction was 
conceptualized as a bipolar variable, and 
which had the capability of being additive or 
nonadditive, depending on the data. 

The model tested. Job satisfactio 
conceptualized as being a functi 


it was therefore 
a model of job 


n was first 
on of mo- 
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tivators, hygienes, the joint v ees 
motivators and hygienes, plus other poten In 
factors and/or errors of measurement. s 
view of the nonadditivity requirement, it wi н 
assumed that the function of interest is po 
in the parameters (Moonan & Wolfe, ne 
р. 501), and that interaction effects e "i 
These considerations lead to the md 

the following statistical model to be tested: 


S=oM+0H+cMH+e — [8] 


Where S — Satisfaction, M — Motivators, 3 
= Hygienes, MH =Joint Contribution к 
motivators and hygienes, а, b, c, and ©, 
parameters. 


Hypotheses 


t 
Three hypotheses were tested in the prese? 
research, jance 
1. A significant proportion of the bend 
in job satisfaction is accounted for by 
tivators and hygienes, hy- 
2. The ааа of motivators pde 
gienes to satisfaction is linear in Ше Faction 
eters but nonadditive; that is, satis jenes- 
is a joint function of motivators and one j 
3. A greater proportion of the var tivatots 
Job satisfaction is contributed by той 
than by hygienes, 


METHOD 


direct 

The method chosen was an analogue of the work- 
experimental approach. In lieu of subjectitie pend 
ers to different physical arrangements, the "This ар” 
ent variables were manipulated verbally- rkers C! 
proach is based оп the assumption that WO without 
accurately evaluate different conden ime the 
being physically subjected to them at the js not 


7 this 
are queried. The present research € ite 
uncommon assumption, one that is ma ersonalit? 
attitude questionnaires, scales, P 


rating 
inventories, etc, — was used 
A complete 3x 3 x 2 factorial design Factor ^ 
with three levels each of a Iova On signs 0 
and hygiene, Factor B, and two classi Factor © 
employces (professional, nonprofessional), ереп, 
to test the model of job satisfaction. An or he гч 
group of 15 Ss was employed in each motivator 
cells of the design. The levels of e mediu™ 
and hygienes were designated (1) high, (2 
and (3) low, 


Treatment Questionnaires 


с 
tth 
z jmpleme™ ch 
A questionnaire format was used to on M 
independent conditions; that is, a secti kers wr 
treatment questionnaire presented мог 
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Statements specifying the relevant conditions. For 
n the nine treatment conditions required by 
whi sign, a Separate questionnaire was designed 

ich paired given levels of a motivator with given 
*vels of a hygiene. 

к е purposes of the present study, it was de- 
of me “ш one job factor to represent the class 
The lvators and another to represent hygienes. 
фы rationale adopted for the selection was to 
and E lhe strongest or most reliable motivator 
of a Yglene factor as denoted by its frequency 
inet ee in workers’ stories. Thus, Achieve- 
in thi Which appeared 41, 55, and 44%, respectively, 

Тее independent studies (Herzberg et al, 1959; 
а 1964; Schwartz et al, 1963), was chosen to 
Оу the class of motivators, and Company 

1 a and Administration (CPA), which appeared 
resent ent 24%, respectively, was chosen to rep- 

nt the class of hygienes. 
stoners of three secondary factors relating to 
from hoe and three relating to CPA were selected 
143 ff) a listed by Herzberg et al. (1959, р. 
factors 0 Provide replication of the main job 
actors Chosen. For Achievement, the three secondary 
Job со chosen were: (1) job accomplishment, (2) 
For mpletion, and (3) solution to job problems. 
Otganizatio the three secondary factors were: (1) 
апа, ‘ation of work, (2) benefit programs, and (3) 
a &ement policies, 

ано, three other secondary factors relating 
tivato, Action, but not explicitly defined as а mo- 
е includ, hygiene by Herzberg, were selected to 
These 5s ed in each of the nine questionnaires. 
(2 actors were: (1) general feelings about work, 
the Ey Increase, and (3) promotion. Items from 
Writte ondary factors (called General items) were 
Cludeq i © reflect only the high level and were in- 
to da All nine questionnaires. Their purpose was 
0 P à common frame of reference so that the 
be - the different pairings of the items could 
лайык Pared to a fixed level across all question- 


те 


1 
маце" Writing. The basis for the item writing was to 
levers Аз formally as possible, the three qualitative 
Six Seco; е underlying continuum for each of the 
Prien te "dary factors. Items were behaviorally 
к in the case of the Achievement items and 
CPA it a concrete situations in the case of the 
(three MS: This procedure resulted in 18 items 
h е s each for the six secondary factors). A 
We nine. list of the 21 items used in constructing 
Inston, questionnaires is given in Table A.* | 
Меен ‘clions and questionnaires formats. The in- 
noe or the questionnaires asked the worker to 


ng the plete list of the 21 items used in construct- 
пае Uestionnaire and a complete sample question- 
Mentais been deposited with the American Docu- 
Dr (On Institute, Order Document No. 9389 from 
ah е ату Publications Project, Photoduplica- 
0540, pices Library of Congress, Washington, D. C. 
PE Photoart in advance $1.25 for microfilm or $ 25 
hotoq Copies and make checks payable to: Chief, 
Cation Service, Library of Congress. 
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think of a time in his job experience when he may 
have experienced the situations to be described. 
Then he was asked to indicate how satisfied he was 
with the situation at the time he was thinking of. 
If he had not experienced all the situations, he was 
asked to imagine how satisfied he would be if he had. 

Each questionnaire was composed of three parts. 

Part I consisted of the nine items presented 
singly (three Achievement, three CPA, and three 
General) for a given questionnaire. The level of the 
three Achievement and three CPA items for a given 
questionnaire depended on the cell it occupied in the 
basic 3 X 3 design. 

The instructions for Part II, in which the items 
were paired, asked workers to read the pairs of 
items, and then, on the basis of their work experience, 
to indicate their degree of satisfaction with both of 
the situations. Part II was the key section of the 
questionnaire in that it assessed the satisfaction of 
workers with different levels of motivators and 
hygienes. 

Part II consisted of 12 pairs of items in a single 
question format. The same items which appeared in 
Part I of a given questionnaire were used to form 
the pairings. The particular pairing of items for a 
given questionnaire depended, as for Part I in which 
the items were presented singly, on the cell it oc- 
cupied in the basic 3X 3 design. Part П of each 
questionnaire also contained the same three questions 
which were composed of three pairings of the three 
high General items. 

A final question, in Part III, asked the worker 
how satisfied he generally felt about his work. 

Directions were the same for all nine question- 
naires. Only the pairings of the items, as required 
by the experimental design, were changed. 


The Response Measure 


Workers were asked to indicate their degree of 
satisfaction with the situations on a 5-point scale 
located below each item. The verbal descriptions of 
the points ranged from dissatisfied through satisfied. 
For the main analysis, the response measure was 
the sum of the nine satisfaction scores obtained from 
the pairings of the nine key items in Part II of the 
questionnaire. This score had a range from 9 to 45, 
with a neutral or zero point at 27. 


Selection of Subjects 


The Ss were selected from a small aerospace re- 
search and development company in Central Pennsyl- 
vania employing about 600 full-time male personnel. 
A roster of all full-time male personnel was obtained, 
and employees were then divided into a professional 
and nonprofessional classification by examining the 
educational requirements for a given job title. A 
given job was considered to be professional if it re- 
quired a minimum of a bachelor's degree. All other 
jobs were classified as nonprofessional. 

A total of 324 Ss (162 professional and 162 
nonprofessional) were selected from the roster by 
taking approximately every other name. 
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Administration of the Questionnaires 


An interoffice memo, under the signature of the 
Director of Professional Development, was Prepared. 
It requested the participation of the addressee in 
a company study on job satisfaction, explained how 
to complete and return the questionnaire to the 
office of Director of Professional Development, and 
guaranteed the anonymity of the respondent. This 
memo was sent to each S at his company office 
together with one of the nine forms of the question- 
uc total N in the sample (324) was divided into 
9 groups of 36 each, corresponding to 36 replications 
of the 9 treatment questionnaires, The Ss were 
assigned to treatments by sending Questionnaires A 
through I to the first 9 Ss on the roster, Question- 
naires A through I to the second 9 Ss on the roster, 


and continuing this process until the list was 
exhausted. 


RESULTS 
Questionnaires Received 


Of the 324 questionnaires sent out, a return 
of 289 usable questionnaires, or 89.2% of the 
original sample, were received within 1 wk, 
The usable questionnaires were then divided 
into 9 groups corresponding to the 9 treat- 
ment conditions. Each group contained a 
minimum of 15 questionnaires for the profes- 
sional and nonprofessional classification, A 
total of 19 questionnaires were randomly dis- 
carded from the groups which contained more 
than 15, leaving a final N of 270 (9 groups 
of 15 nonprofessional employees and 9 groups 
of 15 professional employees). The research 


was based on this final V of 270, or 83.3% 
of the original sample. 


TABLE 1 


ESTIMATED ANALYSIS OF VARIANCE RELIABILITIES 
For EACH OF THE NINE TREATMENT 
CONDITIONS (ОскзттомхАтвкв) 


Questionnaire form Reliability 
A (1,1) 95 
B (1,2) 88 
C (1,3) 87 
D (2,1) 76 
Е (22) 88 
F (2,3) 78 
G (3,1) 74 
н (3,2) т 
І (3,3) 10 


Note.—N = 30 Ss per questionnaire; number of items = 9, 
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Characteristics of Respondents 


The mean age of the Ss was 30.15 P "d 
a standard deviation of 6.10. In irn "nei 
respondents were quite satisfied wit 11% 
work. For the nonprofessional group, fed” 
said they were either “somewhat satis Te 
or “satisfied” with their work, a 
corresponding data were 72% for the pr 
sional group. ч 

The majority of the professional wc. 
were engineers, and many of the depart set 
heads and branch managers also had P nts 
ing backgrounds. For the пору о: by 
there was a wider representation of ther 
job titles. However, they tend to be à a 
skilled group of workers who assist eng! lized 
in the development and building of p 
electronic components, or assemble s 
production models of electronic equipme (re 

No claim is made that this group ds : 
spondents is representative of. all piri. 
unskilled, semiskilled, and skilled ken are 
However, it is believed that the a the 
representative. of employees found 1 ке 
highly competitive aerospace industry; both 
that the professional group represents 
the managerial and technical specialist. 


Reliabilities of the Response Measure 


The analysis of variance model Drs 
1962, p. 124) was employed to es 
the reliability of the response measure. . . 

Shown in Table 1 are the estimate aires 
abilities for the nine treatment question ter 
The numbers in parentheses beside pes 
designating the questionnaire form pe 
the respective levels of the motivato ques- 
hygiene that were paired in the given evel 
tionnaire. Thus, Form A (1,1) refers | (high) 
1 (high) of the motivator, and Level T def 1 
of the hygiene, Form В (1,2) refers to edium 
(high) of the motivator, Level 2 (m 
of the hygiene, etc, 5 

The estimated reliabilities of the ve pa 
measure varied from .70 for the low-lo¥ wi 
ings to .95 for the high-high pairings: 80: 
the mean of the nine reliabilities Lir d 
These data indicate that Ss are general У јас" 
5їзїепї їп endorsing their degree 0 r sg 
tion elicited by the various pairings 
motivator and hygiene items. 


ner, 
ate 


eli- 


pons? 


Tur HERZBERG THEORY 335 
TABLE 2 TABLE 3 
EANS AND STANDARD DEVIATIONS OF THREE ANALYSIS OF VARIANCE SUMMARY 
GENERAL ITEMS INCLUDED IN ALL FORMS 
OF THE QUESTIONNAIRES Source SS df | MS F 
Part I Part IT Achievement (A) | 15425.78 2 | 7712.89 | 317.53» 
ILI Questionnaire __ Company Policy 
ў б form a = (В) 4557.54] 2 | 2278.77 | 93.81% 
SD x SD Employee Classi- 
es fication (C) 81.12 1 81.12 3.34 
124 | 180 A (1,1) 1333 | 221 AXB 31578| 4| 7894| 325 
* ee 2.72 B (1,2) 12.97 2.96 AXC 98.95 2 49.47 2.04 
me | 2 С (1,3) 1343 | 214 pgxc 395| 2| 197| .08 
us | 2413 D (2,1) 1233 | 2.97 AXBXC 160.8| 4| 4009] 1.65 
1243 125 E (2,2) 12.70 2.78 Error (within 
1337 2.46 F (2,3) 13.13 2.15 cell) 6120.80 | 252| 2429 
1300 1.75 G (3,1) 13.90 1,82 
135 1.89 H (3,2) 13.53 2.52 Total 26764.30 | 269 
36 | 154 I (3,3) 1407 | 1.70 


Nore, 
9te,—N = 30 Ss per questionnaire; number of items = 3. 
Response Bias 


а ый on the possibility of response bias 
tivat 5 using the particular pairing of mo- 
satista, and hygiene items to anchor their 
one response), three General items, 
cluded ed in the preceding section, were 10- 
three in Part I of all questionnaires, and 
in p Pairings of those items were included 
existed. II of all questionnaires. If no bias 
could p the means of these General items 
e „е expected to coincide in all forms of 
expecto Tonnaires, whereas a bias might be 
the ed to yield significant difference among 
m The means and standard devia- 
Parts roe three General items included in 
In Table A II of all questionnaires are 5 


deviate ination of the means and standard 
With lons in Table 2 reveals that they are 
of al] pe ™Pling error for both Parts I and IT 
ет, nine questionnaire forms. The £ for the 
е between the highest and lowest 
than : for Part I and Part II are both less 
Тш, Ш?? being .389 and .508, respectively. 
Sponsi the hypothesis of this particular re- 
и Se bias due to the questionnaire format 
Жаркое, Content is thought to be highly 


Main Effects 


мез indicated in Table 3, both of the main 
signif Achievement and CPA, were highly 
cant, showing a reliable relationship be- 


a F(2/252) = 3.04; F.9,(4/252) = 2.42. 


tween these factors and employee satisfac- 
tion. Factor C, employee classification, did 
not reach the F value at the .05 level of sig- 
nificance, indicating that there are no sig- 
nificant differences between the way profes- 
sional and nonprofessional employees relate 
Achievement and CPA to their satisfaction. 
To examine the percentage of variance 
independently accounted for by the main and 
interaction effects, a test, given by Hayes 
(1963, p. 406), was applied to the variance 
data. This test revealed that the main effects 
of the motivator (Achievement) accounted for 
over three-and-one-half times as much of the 
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Fic. 1. Profiles of achievement at levels of com. 
pany policy and company policy at levels of achieve. 
ment. 
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variance (.574) in the criterion as did the 
hygiene (CPA)—.168. The interaction term, 
while significant, accounted for less than 196 
of the variance (.008). 


Interaction Effect 


Profiles of the AB interactions are shown in 
Figure 1. The data have been transferred 
back to a 5-point scale of satisfaction with the 
midpoint being the neutral or “neither satis- 
fied nor dissatisfied" point. 

The strong effect of Achievement on satis- 
faction is evident from an inspection of Fig- 
ure 1. Referring to the left side of the figure, 
even when CPA is high (5,), low Achieve- 
ment (аз) will result in dissatisfaction. The 
converse is not true, however. When Achieve- 
ment is high (a,), even low CPA (23) will 
lower satisfaction to only the neutral point. 
Highest satisfaction is obtained when both 
Achievement and CPA are high, and lowest 
satisfaction is obtained when both are low, 
However, the best predictor of the criterion 
score is Achievement. The slopes between the 
three levels of Achievement (01, a2, аз) across 
CPA are relatively small when compared to 
the slopes of CPA across Achievement. One 
could predict a worker's satisfaction with a 


fair degree of accuracy given only his Achieve- 
ment level. 


Discussion 


In terms of the hypotheses tested, the 
results of the present research are relativ. 
unambiguous. The two classes of antecedent 
variables, motivators and hygienes, accounted 
for nearly 75% of the variance in satisfaction 
scores. This finding is significant for two 
reasons. It indicates first that the treatment 
questionnaires were perceived and answered in 
a fairly consistent manner by the respondents, 
The relatively high analysis of variance esti- 
mates of the reliabilities of the treatment 
questionnaires are simply another indication 
of this fact. And second, the high percentage 
of variance accounted for indicates that mo- 
tivators and hygienes are two classes of job- 
factor variables which can be meaningfully 
related by workers to their job satisfaction. 

The second hypothesis, which predicted an 
interaction between the treatment variables 


ely 
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and the criterion scores, was also confirmed, 
although the magnitude of the interaction was 
small, especially in comparison with the mam 
treatment effects. The magnitude of the inter- 
action effect may place it in that gray area 
of “practical” versus “significant” differences. 
However, it does suggest that the independent 
variables (motivators and hygienes) make 4 
joint contribution to satisfaction over an 
above their weighted sums; and hence the 
effects of motivators and hygienes are not 
independent of one another. if 
The third hypothesis, concerning the dif 
ferential proportion of variance in criterion 
Scores accounted for by motivators and hy- 
gienes, was also confirmed. Motivators, ac- 
counted for nearly three-and-one-half times 
as much variance (.57) as did hygienes (17), 
indicating that, when looking at those two 
classes of variables, workers view motivators 
аз the prime source of their satisfaction. s 
conclusion is further strengthened by the 9 
servation that low or even moderate levels 0 > 
achievement lead to reported feelings of diS 
satisfaction, regardless of the level of the 
hygiene, 1 
These results support the structural mode 
of job satisfaction advanced and tested by ше 
present research. Since no significant differ- 
ences were found between the professional an < 
попргоїеззїопа1 groups employed by the pre? 
ent research, it appears that this model is ар 
propriate for both groups. ions 
At the beginning of this paper, questio? 
were raised concerning ( а) the basic Herzber В 
methodology on which his theory of job ae 
faction rests, and (5) the lack of a statemen 
of the functional relationships between JO 
satisfaction and motivators and hygienes- 
was argued that Herzberg’s conclusions abou" 
the nature of job satisfaction may bea ire 
tion of his methodology and that a mor 
rigorous statement of his theory was neede И 
Such a statement was attempted by the pte : 
ent research. It is now in order to exami" 


—— a "n 

It is recognized that other variables, not aa 
vestigated by the present research, such as the le E 
of overall satisfaction of workers or the type ће 
work (skilled versus unskilled), may affect s 
magnitude of the interaction between motivator® 
and hygienes. This problem is worthy of futur 
investigation, 


is 
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the results of Herzberg and prior researchers 
With regard to the results of the present study. 

0 do this it will be convenient to classify 
Prior research into two rough categories: that 
Which lends support to the Herzberg theory, 


and that which tends not to support the 
theory, 


The Herzberg Theory: Supportive Research 


Three studies (Myers, 1964; Saleh, 1964; 
chwartz et al., 1963) reported results which 
Сее in essential agreement with Herzberg's 
cnclusion that motivators determine satisfac- 
yo and hygienes determine dissatisfaction. 
However, these studies used the basic Herz- 
erg methodology which was criticized by the 
ion Study for a number of reasons. A 
М urth study by Ewen (1964) was equivoca 
in Mostly negative. However, he provided no 
"mation regarding the instructions given 
is 15 Ss, hence no definite conclusions abou 
results can be drawn. . 
"ledlanders (1963, 1964) two studies 
Кие Some support for the theory. In the 
wt (1963) he factor analyzed a 17-item 
Westionnaire which measured the importance 
tion S items as a source of employee pom 
К ` e found three factors, two 0 hers 
of. SPOnded in part with Herzberg’s СО cept 
"ollvation and hygienes, while the аа 
ion * drew from both the motivation ae ae 
R factors, In the second study (е © я 
jop © investigated the bipolar аыр s 
an Satisfaction. Both correlational “т = 
dis. analyses indicated that satisfac d 
а SSatisfaction are, for the most part, un з 
ad not complementary functions. ст ce 
the Method is questionable because b an 
Set, Same items to the Ss under two yc 
it, АЧ with two different emphases hae 
Cms, The first time the items were ie E 
Positively, Ss were given a satisfan we sm 
акей to indicate the importance в, m са 
ite Cir satisfaction. The secon: 


Ss were 
‘ems : araphrased, 
Rives Were negatively parap 


E ked to indicate 
the . а dissatisfied set, ee to their dis- 
зас, Portance of the fac that the 


Е again 
To action. Here one sees ав 


зе Bave been reversed t 
ts his reversal is enough 


M RO t point- 
"не ander’s experimental logic without p 


ing out that it does not necessarily follow 
that Ss will ascribe the same importance to 
reversed items under two different instruc- 
i sets. 

il study which was interpreted by the 
author (Halpern, 1966) as supporting the 
Herzberg theory raises an interesting point. 
Halpern had 93 Ss rate aspects of their best- 
liked job on a 7-point graphic scale. The 
stimuli were four hygiene and four motivator 
items. In addition, he determined a rating of 
the Ss! overall job satisfaction on the same 
scale. He found that two items, Satisfaction 
with Work Itself and Opportunity for Achieve- 
ment, accounted for all of the explained 
variance (7496), and that Ss were equally 
satisfied with both (motivator and hygiene) 
aspects of their job. Halpern (1966) then con- 
cluded that the basic thesis of the Herzberg 
theory that *. . . it is the motivators ee that 
are primarily related to job satisfaction [p 
200]? was supported. i 

However, Herzberg also stated that job 
satisfaction and job dissatisfaction are two 
separate continua which implies that those 
factors which determine job satisfaction (mo- 
tivators) cannot be related to those factors 
which determine job dissatisfaction (hy- 
gienes). Since Halpern’s data show substantial 
correlations between motivator and hygiene 
items, his results could also be interpreted as 
not supporting the theory. The point is that, 
with the theory as loosely formulated as it is, 
different interpretations are possible with the 
same data. 

Halpern’s data, however, do support one 
conclusion of the model of job satisfaction 
tested by the present research, that is, mo- 
tivators and hygienes interact in determining 
workers’ levels of job satisfaction. 


The Herzberg Theory: Nonsupportive Re- 
search 


The data of this study indicate that both 
motivators and hygienes are related to satis- 
faction (conceived of a bipolar variable). The 
results of this study further suggest (see Fig- 
ure 1) that workers with strong feelings of 
achievement on a job will remain satisfied 
even though conditions surrounding the job, 
such as work organization, management 
policies, and benefit programs, are perceived 
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as being inadequate. On the other hand, 
workers who do not feel as if they are ac- 
complishing much on the job will be dis- 
satisfied, even though conditions surrounding 
the job are good. These findings are clearly at 
variance with Herzberg's contention that there 
is no interaction between motivators and hy- 
gienes. 

The differential strength of the relationship 
between motivators, hygienes, and level of 
satisfaction, found in the present study, has 
been reported also by Halpern (1966), 
Gordon (1965), Friedlander (1964), Werni- 
mont (1966), and Burke (1966). All the 
studies cited found that motivators are more 
important to satisfaction than are hygienes, 
Herzberg does not speak directly to this point 
because his methodology was not amenable 
to quantitative expressions of the relation- 
Ships between the variables of interest, 

In addition to the present study, other 
Studies have taken issue with Нег. 
conclusion that specific job factors 
satisfaction in only one direction. Gordon 
(1965), Wernimont (1966), and Burke 
(1966) concluded that motivators and hy- 
Bienes are not unidirectional in their effects. 
And while Friedlander (1964) could find 
little evidence for the bipolarity of job satis- 
faction, neither did his results suggest that it 
is motivators which determine satisfaction and 
hygienes which determine dissatisfaction, 

In Summary, it is seen that those studies 
which directly Support the Herzberg theory 
have employed a questionable methodology 
Which was criticized by the present research 


zberg’s 
affect 


Therefore, the evidence points to the pos- 
sibility that the main Conclusions of the 
Herzberg theory (ie., satisfaction is deter- 
mined by motivators; dissatisfaction js deter- 
mined by hygienes; satisfaction and dissatis. 
faction are two unipolar continua; апа the 


С. A. Linpsay, E. Marks, AND І. Gortow 


correlation between motivators and em. 
is zero) are a function of the methodolog 
evolved by Herzberg. Н ; 
Brayfield (1960) has suggested wv 
sibility, and Kahn (1961) and Vroom ( ms 
have suggested that defensive ery ciate. 
displacement could account for the Her: an 
findings. In addition, Vroom (1964). ne 
Vroom and Maier (1961) have Ree 
against the risk in inferring the actual ca de- 
of satisfaction and dissatisfaction from 
scription of events by individuals. rarity 
To fully resolve the issue of the ra ES 
and/or dimensionality of job satisfactio teres 
the relationship of the variables of ne 
within the Herzberg theory, further ident? 
is necessary. It is believed that the © from 
from the present study as well as ae 
other studies cited, especially Burke per 
is strong enough to cast doubt on pes satis- 
double-dichotomy conception of j^ jenes, 
faction, that is, motivators versus у һе 
Satisfaction versus dissatisfaction. pde este 
that the model of job satisfaction ae or 
by this research, using only one ШО ОП 
and hygiene, is biased, and an sra. јо! 
the remaining or other caer recen 
Satisfaction would alter this model. levant 
Study by Hulin and Smith (1965) is 7 ponents 
They attempted to predict five -—1 work: 
of job satisfaction (satisfaction wit vision 
Dày, promotions, co-workers, and аре е 
from a linear combination of six indep i 
variables, but found only зай, i 
work and pay to be significantly rela ta sug 
set of independent variables. Their da tisfac- 
gested that the five aspects of job А from 
tion under investigation were differen shi 
each other in terms of functional relato en 
and predictability; and further, that “expla? 
model of job satisfaction could best © 
the findings of their study. defini 
Therefore, it is evident that a more ld e* 
tive study of the Herzberg theory show ctio?» 
amine all of the components of satisfac А 
the model which best fits the data, a5 e 
the strength of association between t 
dependent and dependent variables. 


jn 


Generality of Present Research 


^ h oti- 
Although the relationship between Ea d 
vators, hygienes, and satisfaction was 


THE HERZBERG THEORY 


y x the same for both professional and non- 
c essional employees, the generality of the 
ds research is limited by four conditions: 
- The data are based on employees from 
Опе company, 
EU The employees were, in the main, either 
ed or professional. 
with For the most part, Ss were quite satisfied 
i their work. 
+ АП Ss were male. 


Conclusions 
t ч $ following conclusions are based on 
а іг іпќег- 
Pretation, of -the research and their in 
1, 
Nl he class of job factors, known as mo- 
of fc and hygienes in the Herzberg theory 
Ost "ker satisfaction, can be used to describe 
9f the variance in job satisfaction. 
twee: (a) However, the disjoint relationship be- 
by à motivators and hygienes, as postulated 
Dre е Herzberg theory, was not found in the 
Sent research. 
relat Motivators and hygienes appear to be 
гана to job satisfaction in а nonadditive 
Satish, n. This means that a given level of job 
wes ction cannot be predicted from а simple 


ei 
ы sum of the levels of motivators and 


satisa МоЧУабот аге тоге important to job 

a don than are hygienes; this impor 
ing on the order of 3:1. ` 

еро wns further research, Herzberg’s гор? 

of of job satisfaction as being comprise 


wo uni i ld be re- 
Valuateg Polar continua shou 
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DYNAMIC CENTRAL SCOTOMETRY' 


T. SHIPLEY, R. WAYNE JONES, anp A. FRY 


Department of Ophthalmology, University of Miami 


Using radioactivated light sources and 2 
size of the central scotoma is measured 
recovery time to initial sighting is sh 
preadaptation, but the subsequent rate 


levels of preadaptation, with 7 Ss, the 
as a function of time in the dark. The 
own to be a function of the level of 
of scotoma collapse is not. Thus this 


rate of decrease in size is a reliable psychophysical index of vision in normal 
observers. The possible applicability of this measure to questions of vision 


screening is noted. 


Whenever the eye is adapted to a bright 
light its threshold is raised. The time it takes 
for the eye to recover its sensitivity after the 
adapting light is turned off is called the 
“recovery time” (e.g., Chilaris, 1962; Fry & 
Miller, 1964). The measurement of this time, 
for either fixed or constantly decreasing in- 
tensities, is the now classical procedure for 
determining normative dark-adaptation curves 
and related threshold functions (e.g., Hecht, 
Haig, & Wald, 1935; Hecht, Haig, & Chase, 
1941). In various forms these procedures are 
widely applied to clinical (e.g, Forsius, 
Krause, & Eriksson, 1964a, 1964b) and to 
engineering (e.g., Severin, Newton, & Culver, 
1962) problems. Terms such as dazzle re- 
covery, Photostress, and flash blindness 
recovery have been used to describe this event. 

Instead of measuring the time for a given 
retinal region to recover, it is also possible to 
measure the size of the retinal region which, 
at a given time and for a given intensity, has 
one measures the size 


of the re ch is insensitive, that 
is, is blind or Scotomatous, to the stimulus 


period of rest in darknes 


of the “absolute” central Scotoma (e g 
T 


‚ке 2990, measure- 
ment of this blind region is referred to as 


A а norma] 
physiological event which can readily be 


1Supported by contract 35DA-49-193-MD. 2544 
from the Office of the United States Surgeon General. 
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or 


о 
measured with large stimuli, say of 1 al 


greater. It exists because the perip i 
threshold up to about 17° (as mediate ү 
many rod cells converging upon one ai d 
cell) is significantly better (i.e, lower) nly 
the central threshold (as mediated by 9 on 
one or only a few cone cells converging. "hiis 
one ganglion cell) —Hecht et al., 1935. plue 
scotoma may be particularly large in 
light. ze dif- 
Since different retinal regions may take d 
ferent times to reach a given sensitivity light 
it is possible to use a fixed low-intensity l8 7 
Source and to measure the time in the this 
after light adaptation that it takes 0 ren 
light source to be seen in these diffe i 
regions. The apparatus should be arrange pe 
Such a way that the light source nr or 
moved continuously in the visual fiel may 
moved at will. Thus a dynamic measure 

be obtained of the regions which, at pen a 
times, are insensitive to this light. This ela- 
dynamic plot of changing field size, ОГ ain 
tive scotoma versus time in the dark: thu 
dynamic Scotometry. 


jous 


Tue Present EXPERIMENT 


Ў the 

The present experiment measures the size ae 

relative central scotoma (after a fixed light e 

tion and to a target of fixed size and intensity 

this dynamic fashion. Its purpose is twofold: func- 
to determine the basic normative shape of the 


rst 


‹ > ;Q the 
tion “size of central scotoma against time inction 
dark," and Second, to attempt to relate this fu anc 


to individual differences in the visual perform 
ae 


rc 
2 Еог much smaller stimuli (e.g., 2.7 min. of om 
the situation is reversed and a Peripheral pa is 
may be found (cf. Arden & Weale, 1954). y^ 
also true for large targets (1?) in the far peripher. е 
Ъеуопа 10°-20°—where the sensitivity curve 
Verses and falls (cf, Sloan, 1947), 


$5 


Dynamic CENTRAL SCOTOMETRY 


of normal observers. It is assumed, for example, 
that for any given stimulus condition the observer 
(0) with the smallest central scotoma will naturally 
ave the highest potential for good visual efficiency. 
о this latter end, the apparatus must be readily 
Portable and compatible in its use with typical 
Clinical Procedures, 


APPARATUS AND GENERAL PROCEDURE 


ШЕ ррага{из is shown schematically in Figure 1. 
QURE targets (Ti, T.) are two small 10 min. 
war discs of radioactivated carbon-14 phosphors 
nana States Radium Corporation) with lumi- 
tdas matched at about 0.6 uL. (c. 19 Х 10 
aa The predominately blue-green «ов 
(The ОЁ the phosphor is also shown in Figure 1. 
© amount of radioactivity involved is negligible.) 
f 2 intensity of these sources will remain constant 
ад © life of the instrument. However, if they ае 
Vertently exposed to light it is necessary to wai 
ed hours before resuming testing. For this n 
light GC is carefully mounted in a holder дїй a 
lights tt cap which remains closed until all ro 
In Fee, CXtinguished. | Ha 
Scoto, 241 1, the subject (S) is seen in front 0 ae 
‚ Meter and the experimenter (E) behind. 
is tested monocularly. The preliminary light adap- 


wae 15 given by a hemispherical light source. € 
White eld light source of relatively homogen oe 
е light will do, The S must be carefully instruc M 
ding? his eyes open and to look straight п 
Кы the preadaptation period to assure а con 
a light adaptation. А | — 
into er this, S pivots on a swivel chair an d 
fig, пе headrest. He then fixates the small v^ 
uu light (F), Since it takes at least in us A 
Com See this light after the light adaptation d um 
Con pleted, this maneuver in no way азар Ж 
To, tinuity of the experiment provided only tha 
An Pig ied light iR, жы 
Si € light-adaptation lig | ‹ 
owe Rating, E monitors this fixation by raising ee 
те “ting the brightness of the red fixation n i 
i үз S to describe what is happening. ote 
йеп that S is fixating properly, he iens rue 
the sity of the fixation light until it is Jus yo 
Теш and henceforth keeps it at mn 
nd E now opens the cap covering the test аш 
(by ©ХРозев it to S. The S is instructed i in M 
lapping) when he sees this AU. nne = 


turned off and 


Stay i 

tio tly cautioned not to move his eyes 
On the f Hecht 

а the basis of the classical findings pe 2 

Sti al, (1935), although extrapolating from peel 
Шз to a 10 min, of arc one, the predicti os 

erin that the target would be = ae па 

егу than near the fovea. There'ore d 

3 ea 

pos first Presented in the farthest pmi pum 

frg, ted by the instrument, and we 

> there. The single target, Ta ОГ T. ae ese 

Pd be, was presented successively in em cis 

the cardinal retinal directions. The atm ( 

the target was pivoted by Ё into these positions. 
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Fic. 1. Schematic drawing of the apparatus. (LA, 
light-adaptation dome; F, fixation point; A, rotating 
arm; Ti, Tr, targets; 1, Irn degrees indicators; K, 
contro] knob; P, artificial pupil; S, subject; E, 
experimenter.) 


The sequence of these directions was systematically 
counterbalanced between Ss and experimental ses- 
sions to control for bias. The S was told in which 
direction to expect the light to appear. As soon as 
S saw the light and began tapping, E recorded the 
time and the target position, as given by the degrees 
indicator (Iı or Ir). The E then moved the target 
inward, by means of the control knob (К), to 
where S ceased to see it. Then S again waited until 
it was seen—this process was iterative until the 
absolute central scotoma was reached. 


Experiment 1 


The testing of untrained Ss was preceded by 
studies on trained Os in order that the principles 
involved might first be elucidated. For this experi- 
ment the authors served as Ss. As noted, the disc 
was 10 min. of arc to match the common clinical 
perimetric target (3/1000). The pupils were dilated 
with mydriacyl. The S first dark-adapted for 10 
min. Then followed a light adaptation of 2 min. 
to 414 cd/m? of white light (obtained with a 
fluorescent lamp adaptometer of the authors’ design, 
placed as in Figure 1). A 5-mm. artificial pupil was 
worn about 15 mm. before the cornea during the 
scotometry measurements (not during light adapta- 
tion). Under these conditions, the maximum роз- 
sible peripherality of the target was 16.51°. 

Since the eye is held still throughout this experi- 
ment and since the target is simultaneously both 
far in the periphery and below cone threshold, it 
irequently fades in and out in accordance with 
the Troxler effect. All threshold perimetric studies 
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Fic. 2. The size of the central Scotoma as 
of 10 min. of arc and 0.6 BL. (N 


will be confounded by this effect, and it must be 
said that the results 


the face of this rando 


to counter this by oscillating the target back and 
forth over a few de 


, is, the target was 
moved at a consistent and steady rate from O to О. 


concerning an annulus 
tivity at about 109-14» 
in accord with the positi 
at 17^, nor with Sloan's 
point at 17?. Quite prob 
size (Sloan's 1° 
study) and of 


operating there must be some 
old mechanism based upon rod 


flicker the 
xler effect, 
ence and a 


‘complicated 
presentation. 
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rget 
a function of time in the dark for a blue-green targ 


= 3 trained observers.) ; 
T. 
target appears only as an amorphous ee proves 
luminosity, Inside of say 5°, visual кон crc 
and S becomes aware of the emergence ШАТ shape 
vision as the target takes on a visibly circu " retina 
Despite these difficulties, the results for а nicely: 
directions and for all Os converge rather plotted 
These are shown in Figure 2, where we have against 
the size of the central scotoma (as ordinate) is 
time in the dark (as abscissa). Each curve ^ р, 
best fitting curve of four runs. КЛ 
(Олк) drops rapidly and has no measurable measure 
scotoma. (N.B.: the instrument could not ze i 
а scotoma under 10 min. of arc in size ОГ (Ол? 
0.7? of the fovea. Observer R. W. J- irection? 
drops significantly more slowly in all four di retinal 
and has a scotoma of 2.4° along the ee ia 
axis. Observer T. S. (Ors) falls at e nasa 
rates and has a very slight scotoma along t 
axis. "m. 
These data indicate that, for a 10 min. lig 
target, the retinal periphery adapts only very 5 $ 
faster than does the perimacular region. 
following the previous argument, they show 
is possible to rank these Os in terms of their DO > 
Skill in night visual tasks: Оль, Отв, and Ова] 
that order. While these Os have identical “20/20 
epicritic vision under photopic conditions also 
acuity), their foveal dark-adaptation curves E 
show this same general rank order though 
lesser degree. 


that ? 
tentia 
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Experiment 2 


This experiment proceeded in principle as the first, 
except for the taking of standard Goldmann dark- 
adaptation curves (3 min. light adaptation to 1,017 
Simi, g* tungsten white target, 11° above the 
ovea, natural pupils). The S rested in relative dark- 
088 for 10 min., during which time he was instructed 
ш Бо test procedures, dark adaptation and 
Scotometry, Each S came for two 90-min. sessions. 
д each session one standard dark-adaptation curve 
D min.) was taken, and four scotometry measure- 
El (about 10-15 min. each) were taken, one 1n 
Ach of the four cardinal retinal directions. Rest 


в Were interspersed when necessary. The ex- 
Periment y 


Se Was particularly demanding on naive ob- 
tvers, but the results suggest that measurements Jn 
Prob One direction (probably temporal) wong 
adaj 07 suffice for mass testing. Scotometry LM 
or station Was 2 min. to 1,017 cd/m?. The resu 
i o of the authors and five naive Ss are given 
tion igure 4, Since this figure presents à je oma 
Sary of the raw data (unlike Figure 2), it is ne 

Y to describe how it was plotted. ~ i 
the 5 may be done by referring to Figure 3 W = 

‚ "aw data were plotted, as in Figure 2, for део 
and опе О (S, §.—Oss) giving unreliable ups 
age Ше Other, Onws, giving data of am La 
ot reliability, By reliability is meant the repea a. 

© length of time it took, along a given SM 

signig Ste the target. Although this DE. s 
те cantly for Onw along the various men! e 
Deats reasonably well for a given meridian’ i 
sigh 9h the other hand, one sees that the ed Eus 
alo ting varies widely from session to sessio 

"Е the same meridian. — 
De “WO points emerge: the first is that, ши. 

timent 1, where the lapsed time to first 99 
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teh 
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Fic. 3. An illustration of the method ber s 
the data: (а) raw data from trained Onws} 


ata from naive Oss. 
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TABLE 1 


LAPSED TIE FOR OBSERVERS IN EXPERIMENT 2 


Observer Lapsed time* SD 
5.22 1.22 

One 790 0.99 
Oss 8.30 2.79 
Омв 8.37 1.68 
Onx 8.46 1.02 
Ову 9.30 1.63 
Oar 9.35 0.49 


a In minutes. 


was only about 1-2 min., the lapsed times here are 
large, running up to as much as 12 min. The mean 
lapsed time for all Os and all meridians is 8.13 min. 
with a standard deviation of 141. тһе lapsed times 
{ог each observer are given in Table 1. This long 
initial delay must be due to the much higher level 
of preadaptation obtained in this experiment in 
comparison to that of Experiment 1: that is, 2 mum. 
to 1017 cd/m? instead of 2 min. to 414 cd/m?. 
Physiologically, this is probably because. the rods 
were saturated in Experiment 2 and not in Experi- 
ment 1. А 

One could thus probably derive a parameter 
pertinent to night vision by a systematic variation 
of the light-adaptation conditions. This parameter 
might be lapsed (or recovery) time weighted, some- 
how, by its own reliability. Perhaps it is the failure 
to take into consideration the reliability of the re- 
covery time that has, in the past, led most workers 
to reject lapsed time as an index of night vision. 
The variations in this time within and between Ss 
may be due to the operation of factors which some 
Ss cannot consistently control, such as squinting 
during light adaptation or improper fixation during 
dark adaptation, which might also hinder them in 
other visual tasks of high demand. 

Second, and more important, the point emerges, 
even from the data of Oss and despite the variations 
in lapsed times, that the slopes of the curves, that is, 
the rates at which the scotoma collapses or shrinks 
with time (thus degrees/minute), remain fairly con- 
stant. For example, the slopes for Onws are the 
same in Figure 2 and in Figure 3 despite the great 
difference in light adaptation. And they are ap- 
proximately the same as those for Oss in Figure 3 
despite her poor reliability. Since it is this rate in 
which there is interest, the data have been replotted 
to permit the ready comparison of slopes. To this 
end, the authors took the time of first sighting the 
target at 14? as time zero and expressed all other 
times as minutes from this. Each curve in Figure 4 
is thus a raw-data curve slid along the abscissa 
to the leít by the time it took to first see the target 
at 14?. Figure 4 also includes the standard Gold- 


mann dark-adaptation curves for comparison with 
the scotometric curves. 
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It appears that all Os display the same basic func- 
tion. But Oss stands out because of her large absolute 
scotoma (in one instance as large as 3?); and 
О К. К. (Оюк) stands out because of his smaller 
slopes during the critical early minutes; and 
perhaps Oar also stands out because of her very 
large early slopes. 


Discussion 


Individual differences are displayed by 
this procedure in at least four ways: time to 
initial sighting (Table 1, column 2); variance 
in time to initial sighting (Table 1, column 
3); slope or rate of collapse of central 
Scotoma (Figure 4); and size of final absolute 
central scotoma (Figure 4). Such individual 
differences do not appear between these Os 
tested with standard Photopic acuity measures 


(20/20) or with standard Goldmann dark- 
adaptation curves, 


Superior Retina 
~ Inferior Retina 
71 Temporal Retina 
"- Nasal Retina 


SIZE OF CENTRAL SCOTOMA (degrees) 


E 6 o 2 4 6 
TIME FROM INITIAL SIGHTING (minutes) 

Fic. 4. The size of the central sco 
tion of time in the dark for а 
of 10 min. of arc and 0.6 uL. (ү 
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Fic. 5. Final composite curve. 


e 

Although it cannot be asserted that ү 
differences will be related to visual рег sight 
ance under high demand situations (еб 
vision), it would seem that they er 1 the 
has already been suggested that O pe tive 
largest central scotoma, whether re Teast 
(Onx) or absolute (Ogg), will have mast o 
potential for good visual performance а 
intensity levels. Similarly, one exp wei В 
unreliable observer (say O M. an . 
to be worse than the reliable one (say ig t 
The procedure of dynamic scotometry pe^ 
thus be further explored and attempts | dif- 
{0 correlate the results with individual ks. 
ferences obtained in other night-vision we 

Most important, however, is the ae 
Which emerges from the data of Figure 4; 
the method is Sufficiently reliable so t 
allow the authors to display a basic phys! ces 
ical function, Despite individual differen o 
among the five normal Os, the reliability al- 
the slopes (excluding Ogg and Окк as ^E t 
ready been noted) is quite as good a5 ical 
obtained for other comparable psychophys 
functions. 1 05 

On this basis, the mean data for al 
have been combined into а scattergram, m 
best-fitting monotonic curve has been T he 
through them, as shown in Figure 5. rve 
dashed line is thus the mean composite ү: ur 
(from Figure 4) for five Os and for ipe 
retinal directions and two trials. This Lad 
may probably be assumed to hold in а пог" 
tive sense for the whole retina, Tt supports 
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Concept of the radial symmetry of the retina, 
d least in terms of the organization of rod- 
7 cell interactions. And it shows (for 
ү uL.-10 min. of arc blue-green target) 
tivit 1e same relatively low level of rod sensi- 
1015 I5 attained within 3 min. over the whole 

r central rod retinal field of 14°-2°.* 
ine fast slope implies that these thresholds 
ganglio only a relatively илсопуегдей rod- 
show de cell population and, because of this, 
D ittle if any advantage in rod as opposed 

De vision, 
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FEEDBACK IN A COMPLEX MULTIMAN-MACHINE SYSTEM 


IRWIN L. GOLDSTEIN,? JACK Е. SOUTHARD;? дахр DAVID A. SCHUM 4 
Ohio State University 
Human decision makers provided hypotheses and made diagnoses, in the form 


of conditional probability judgments, to account for the occurrence of алаа 
critical events іп а simulated hostile environment. The decision makers’ prob- 


abilistic estimates were com 
model for several levels of 
67%, and 100% 
estimates). The 


probabilistic estimates provided for 33 


were superior to 0% 
model estimates as f 
nificantly even thoug 


pared with similar estimates provided by a Bayesian 
percentage of knowledge of results (KR; 0%, 33%, 
) and 2 levels of specificity of KR (access or no access to model 
data indicated that there were no significant differences in the 
Jo, 67%, and 100% KR but that all 3 
KR. The human decision makers with access to Bayesian 
eedback were not able to improve their judgments sig- 
h the model-generated solutions were significantly superior 


to human estimates at all KR levels above 0%. 


A series of experiments (Schum, Goldstein, 
& Southard, 1966) have investigated variables 
affecting the decision maker’s ability to select 
or formulate hypotheses to explain the oc- 
currence of a certain set of observed data. 
These investigations involved diagnosis of 
threats in a man-machine systems format. The 
decision maker provided hypotheses and made 
diagnoses, in the form of conditional prob- 
ability estimates, to account for the occur- 
rence of certain critical events in a simulated 
hostile or potentially hostile environment. It 
happens that there is a formal quantitative 
statement, Dodson’s (1961) revision of Bayes’ 
theorem for multiple-data classes, which de- 
scribes how one ought to revise his opinions 
about the probability of some hypothesis in 
the light of new data or experience. In studies 
investigating reduced 
formation (Schum, G 
1965a) and restrictio: 


; Goldstein, & Southard, 
1965b), humans Were, on occasion, able to 


1 Тһе research Teported in this Paper was carried 
out at the Human Performance Center and was 
sponsored by the Aerospace Medical Research Lab- 
oratories, Aerospace Medical Division, Air Force 
Systems Command, Wright-Patterson Air Force Base, 
Ohio, under Contract No. AF 33(615)-2248 with 
the Ohio State University Research Foundation, 
Further reproduction is authorized to Satisfy the 
needs of the United States Government. 

2 Now at the University of Maryland, 

3 Now at Miami University (Ohio). 

4 Now at Rice University. 


the 
provide higher probability estimates I thesis 
Bayesian model in the correct yp е; 
category. However, human decision model 
were always inferior to the Bayesian othesis 
in terms of identifying the correct hyp Briggs 
category with first-choice estimater iat in- 
and Schum (1965) have pointed out that 
terpretations regarding these investiga 
decision making have been limited ! pro 
those subjects (Ss) providing posterior with 
ability estimates were always ene true 
complete knowledge of results about t rime 
State of the world. The present ed 
was concerned with the investigation 
effects of this variable, esults” 

In general, the term “knowledge of rm in- 
(KR) refers to information given we out- 
dividual or group of individuals about onses: 
come of a response or group of resp wat? 
Enough research has been conducted t value 
rant the conclusion that KR is of E per 
in a large variety of tasks including Т), 
formance on an ergograph (Arps, 5) and 
grading handwriting (Gilliland, 1925), i. 
performance on a complex arm-leg CÓ і 
tion task in industry (Lindahl, 1945 ) int 
difficult, however, in a complex task т етан 
human Ss to state the effects of SYS ificit 
variations in percentage of KR or spe cg 
of KR. Studies varying percentage ding to 
are few in number and suggest, accor” is 
Kimble (1961), that performance it ы 
usually, but not always somewhat por ne 
Їр. 161]" for partial than for continuou 


А pels 
ditions. Both Kimble (1961) and Mic 
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(1955) report a marked reduction in learn- 
ing when the level of reinforced trials falls 
below 20% or 25%. In a complex man- 
machine system format it is difficult to predict 
how much feedback is necessary to sustain 
Performance, but it does appear that 10076 
feedback: may be superfluous. Р 
The other KR variable investigated in this 
Study was specificity of KR. This typically 
refers to the precision with which error 15 
indicated in a single dimension of perform- 
ance. Increased specificity involves two com- 
Ponents: one, a directional component which 
States д relationship between S’s response 
and the desired correct response; and the 
Other, the number of discriminable response 
Categories available to S (Annett, 1961). It 
арреагѕ that increases in specificity which 
"Wolve the second component do not always 
Tesult in superior performance (Eriksen, 1958; 
reen, Zimiles, & Spragg, 1955) and may, E 
ct, even degrade performance through E 
confusion generated py such unnecessary de- 
en (Crafts & Gilbert, 1935). It seems reason- 
able to state that there is little benefit from 
using a wider range of categories in KR than 
as available in his potential response 
“ebertoire (Annett, 1961). 


METHOD 
Generat task The simulation facility P 
ш article is applicable to a wide Vane ach on 
oe involving multiple levels of in a Aquen 
Processing and decision-making functions. that 
Far format chosen for this investigation ^ = Bilt 
ап intelligence agency at some unsp 

Presumably high decision level. ter facility 
n the present experiment a compl jex seal: 
Provided the means for generating а COE sereni 
ШҮ stimulus environment simulating the m al 
aL the Surface and air forces of а x Hie: 
Adversary called “aggressor.” A team 0 Беи 
{hated as intelligence staff oficera ПЗУ a ' 
‘dentis, nts taking plac нв. 
огу йыл, dm use of simulated ice 
eir information was communicated thou са 3 
quit TV to another group of Ss cr at 
cision makers (DMs) whose job it was ел 

die threat posed by orderly buildups 9* ? 
"ces appearing in the environment. 


lity described in 


ine, Paid on an hourly basis. 
"ital training consisting of 60-11 
Problems, and on-the-job training a5 
ther instructions specific to the ех 


hr. of lectures, 
' well as fur- 
periment. All 


о = Inferred Aggressor Units 
A: Aggressor Installations 


‚ 1. A schematic diagram of aggressor territory 
ЕН (highly simplified). 


decision makers had served at least 6 mo. in previous 
man-machine system experiments, : 

Stimulus environment. Aggressor territory was de- 
fined as a square area 1,024 mi. on each side. Within 
this territory, in a time-dependent fashion, there 
occurred orderly buildups of aggressor forces which 
were called developmental groupings. In the present 
experiment there could be as many as 25 individual 
developmental groupings in various stages of buildup 
in aggressor territory at any one time. Figure 1, 
a highly simplified abstraction of the basic environ- 
ment, illustrates this buildup process. The large tri- 
angles in the figure represent certain fixed installa- 
tions such as forts, supply depots, and airfields. 
The clusters of small circles represent units of 
aggressor’s surface and air forces. Each cluster 
represents developmental groupings which are in 
various stages of buildup. A developmental grouping 
reached the terminal stage of buildup when all of its 
associated units had reached their final location 
along one of the four borders. When this occurred, 
the developmental grouping remained there for a 
set period of time and then terminated by disappear- 
ing from the environment. System load was defined 
as the number of developmental groupings terminat- 
ing in an experimental session. In the present experi- 
ment, six groupings terminated every session. 

Information-processing task (ISO). All input 
information occurred only at the request of one of 
the four ISOs, each of whom was responsible for a 
different major class of information (main attack, 
combat support, logistics, or order of battle). A 
chief of staff initiated the starting procedure by 
choosing an area of aggressor territory for a simu- 
lated reconnaissance overflight. The computer then 
made available simulated photographic, radar, and 
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ТАВГЕ 1 


PERCENTAGE OF JUDGMENTS RECEIVING FEEDBACK 


Basis of 


feedback | 0% 3395 | 67% | 100% 
I EC AF | DG | H5 
II E,C A,F D,G HB 


Note.—I = DM's own judgment of P(H|D). II = DM's 
and Bayes' judgment of P(H|D). A-H 7 Hypothesis categories. 


infrared sensor data in verbal and numerical form. 
The next stage was initiated by the ISOs who 
interrogated computer storage through their dis- 
play consoles. The information thus obtained pro- 
vided the ISO with descriptions of the type, num- 
ber, activity, and location of collections of mobile 
weapons, vehicles, and aircraft, Using reference tables 
which related numbers and types of elements to 
aggressor units, the ISOs attempted to infer the ex- 
istence of the various aggressor units in a develop- 
mental grouping and the spatial and temporal ar- 
rangements of these inferred units, This Was a com- 
plex time-oriented process which was complicated 
further by the extent of the environment, 

The ISO obtained as much information as pos. 
sible about a particular deployment and then at- 
tached probability estimates to the various levels of 
each predictor. There were 25 Such predictors (at- 
tribute classes), each associated with a varying num- 
ber of possible states. For example, in Attribute Class 
10, a given deployment might have had zero, one, 
two, or three tactical air Support squadrons (ie, 
this predictor has four Possible states). The ргоЬ- 
ability estimates required of ISO were intended to 
reflect his confidence in the number of tactical air 
squadrons actually present in the deployment. Thus, 


Decision-making task (DM ). The decision makers 
received the probability information from the ISOs 
and used these data to evaluate the threat posed 
by the six different developmental groupings that 
terminated in each session. Thus, the DMs esti- 
mated the probability (P) of а particular type or 
deployment (H) given the probabilistic attribute 
data (D) describing the Characteristic of the de- 
velopmental grouping. Each of the eight DMs per- 
formed this task independently even though they 
all received the same information from Ње ISOs. 


І. І. GozpsrEI, J. Е. SouTHarp, AND D. А. SCHUM 


Each grouping was classified into one of eight ee 
ent hypotheses [P(H/D)] which described Бен їп 
sible strategies to be employed by bd rs of 
initiating some hostile action across the bor imply 
his homeland area. These hypotheses were Si 
labeled alphabetically A through H. ilistic 
The DM provided another type of etu 
estimate, namely, the probability that the a (a 
attribute data (D) would be observed ion 
particular hypothesis) were true. These to ob- 
estimates were used in the Bayesian solution 
tain the model's P(H/D) estimate. u 
Design. Eight DMs were assigned to two e 0 
four each, which were distinguished on the А Group 
the kind of feedback provided (see Table D ir own 
I received knowledge of the accuracy of 2 wledge 
judgments only, and Group II received хари those 
of the accuracy of their own judgments and о both 
Provided by a Bayesian process as well. Po for 
groups the judgments of interest were Р(Н/. othesis 
eight hypothesis categories. The eight AT four 
categories, A through Н, were divided en feed- 
groups of two each. As illustrated in Table sct bu 
back was never given when E ог C was corre 
was given 33% of the time when Category 


ps of 


was 
F was correct, 67% of the time when D or B was 
correct, and 100% of the time when Н oF tal 


еп 
Correct. There was а tota] of 86 Чебеш 
groupings Presented for each level of percen 
R. 


REsuLts AND DiscUSSION 


5 

The results were analyzed using two ku 
of response measures: one, a verified cen ну 
Score (VCS) which is the actual probat an 
placed in the correct hypothesis category) ayr e 
the other, a dichotomous scoring prosa h- 
(DS) where S is given full credit if the ye 
est probability is placed in the right, the 
pothesis category and no credit at all 
highest Probability is placed in one 0 тте 
wrong hypothesis categories. If a tie 0CCU 
between severa] hypothesis categories pm was 
of these was Correct, proportional credi 
given. f 
The analysis of variance of the VCS mo 
the DS indicated the same pattern of 7 {от 
cant effects, The similarity of the e d bY 
the two response measures is corroborate iy 
an examination of Figures 2 and 3 ee cast 
Similar functions for the two depen 
measures, e of 

The effects of the changes in percenta& ca 
KR provided the most pertinent x 97, 
in this study—for VCS, F(3/1026) = 157. < 
Ф < .001; for DS, F(3/1026) = 167.29, 
:001. The data were further analyzed by 
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Newman-Keuls test which indicated that the 
main effect (for both types of dependent 
prium occurred between 0% and 33% 
i5 (0 < .01) with no differences between 
1670, 6176, and 100% KR. The data support 
tu motion that human beings, even in very 
m Situations, do not necessarily need 
% KR to sustain performance. Though 
fad necessary amount of feedback is a very 
ion, Гес question, there are many situa- 
t ® Where it is very difficult to provide any- 
note like 100% KR and it is encouraging to 
Whi Dat. there is some evidence developing 
iiw Points to a critical level somewhere 
‘Ween 0% and 33% KR. 
ы earlier studies Schum et al. (1966) 
Usin that the human P(H/D) responses 
(For 4 Gichotomous scores were often equal 
tior p Sh-fidelity conditions) but never supe- 
conditi the Bayesian model. For low-fidelity 
lor tions, the model was consistently supe- 
tect-hy its first-choice estimates of the cor- 
or Ypothesis category. This indicated that 
make consistency was present in the decision 
“15 estimates of P(D/H) than they were 
Vas to use in estimating P(H/D). The ie 
esti able to aggregate the human P(D/ ) 
Mates and consequently was superior on 


Humon * Boyes’ 


e~e — Human Miror 

4———^  Humon lum ' 

*----»e Bayes’ Human+ Bayes 
8 4--—-  Boyes Humon 


Mean Verified Certainty 


100 


33 67 
F Percent KR - 
i P(H, 
Ostim 2. Human and Bayesian model up ze e 


Spe ates as a function of percentage 
“icity of KR, 
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Type KR 


100} 


сә  Humon Нитоп+ Bayes" 
a—4 Human Human Е 
e---  Boyes Нитап+ Bayes 
4----- Вауеѕ$ Human 


о 
о 


o 
o 


r3 
о 


Mean Percent Dichotomous Scores Correct 
З 


зз er 100 
Percent KR 


Fic. 3. Human and Bayesian model mean percent 
dichotomous scores correct as a function of percent- 
age of KR and specificity of KR. 


the basis of first-choice estimates. Using veri- 
fied certainty scores, previous studies (Schum 
et al., 1966) indicated that human decision 
makers were able on occasion to provide su- 
perior P(H/D) estimates. One of the reasons 
advanced to explain these data was that Ss 
could, without penalty, maximize P(H/D) in 
hypothesis categories they considered likely to 
be correct. However, as occurred with the 
dichotomous measures, the human verified 
certainty scores were inferior to the Bayesian 
model for reduced fidelity conditions. In the 
present study the dichotomous and verified 
certainty scores were consistent in the out- 
put analysis. That is, the model estimates of 
P(H/D) were consistently superior to the 
human data for the 33%, 67%, and 100% 
KR conditions—for VCS, F(1/342)= 69.67, 
р < 001; for DS, F(1/342)— 23.93, p< 
.001. If the relationship between high fidelity 
of information and high percentage of KR 
could be equated, the humans would have 
been expected to perform as well as the 
model for the higher percentage of results con- 
ditions. Obviously this did not occur, and it 
seems likely that the large number of develop- 
mental groupings on which the decision maker 


Mean Verified Certainty 
> 


33 67 100 


Percent KR 


Fic. 4. Human and Bayesian model mean P(H/D) 
estimates as a function of percentage of КВ. 


did not receive feedback (the 0%, 33%, and 
67% groups) prevented а complete under- 
standing of the type of developmental group- 
ings each P(H/D) hypothesis could Possibly 
include. Thus, the lack of complete feedback 
resulted in an ambiguous situation which has 
been shown to result in superior model esti- 
mates of P(H/D). 

The interaction between percentage of KR 
and the output—for VCS, F(3/1026)— 13.67, 
№ < .001; for DS, F(3/1026)— 6.17, p< 
-001—again pointed to the importance of the 
percentage of KR condition between 096 and 
3376. An examination of Figure 4 Showing 
the verified certainty scores (the dichotomous 
relationship was similar) Supported this con- 
tention. The model and human responses at 
the 0% KR level overlapped. Without any 


human nor the model 
estimates from the 
VCS, F(3/1026)= 4.39, P<.01; for DS, 
F(3/1026)= 5.42, p < :01—аѕ seen in Figures 
2 and 3 indicated that the interaction between 
percentage of KR and output changed as д 
function of the type of feedback. 

The effects of specificity of feedback were 
not significant, indicating that the extra feed- 
back given by the Bayesian model to the DMs 
did not provide more accurate judgments than 
feedback from the DM's own response. Yet, 
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t 
as indicated by the significant augue 
the model did produce superior P(H/ ble to 
Sponses. It appears that S was not " the 
use the extra information presión Ti 
model or, as one experimenter (Annet е re- 
has put it, the number of чаа E 
Sponse categories provided by the K "here. i 
match S's ability to discriminate. оба 
one other possible explanation. А "onim 
previous experiment in this series ( of the 
Schum, 1965) exploring the use that de 
Bayesian model as an aid indicated n 
Cision makers were unwilling to rely alysis, 
model solution and, in the final es 
preferred their own judgments. тз, study 
not appear to be the case in the presen ani 
where the DMs had much тоге SR 
training and were very familiar eni 
optimal nature of the Bayesian solu that the 
this reason, it appears more likely feedback 
DMs were not able to use the extra urthe 
provided by the model. In either case, tions ÍS 
exploration in a wide variety of ud 0 
necessary іп order to extend the gener 


entage 
the effects of specificity of KR and pere 
of KR. 
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INFLUENCE OF INTERPOLATED PERIODS OF ACTIVITY 


AND INACTIVITY UPON THE VIGILANCE 
DECREMENT * 


WILLIAM BEVAN, LLOYD L. AVANT, AND HARRY С. LANKFORD 


Kansas State University 


4 independent groups were observed in a simple visual detection task. The 
control group, which monitored the display continuously for 90 min., suffered 

i mance during the course of observation. 1 experi- 
mental group engaged in vigorous Physical exercise for 5 min. after each 30 


min. of watch-keeping, the 2nd group solved anagrams for 5-min periods, and 
the 3rd was subjected to 5-min periods of 


This simple experiment is а recapitulation 
of sorts. Tt examines, under a common set of 
conditions, the effect both of periods of 
activity and of inactivity upon signal detec- 
tion, for the light its data may throw upon the 
activation theory of vigilance. 

First suggested by Deese (1955), 
elaborated on a growing background of 
formation about the Reticular Activating 
System, this theory postulates a curvilinear 
relationship between alertness and the level 
of central nervous system (CNS) activity 
produced by overall Sensory input and/or 
central feedback, with maximum alertness 
being associated with some intermediate level 
of activity. It accommodates a variety of 
empirical results: superior performance as- 
sociated with high as contrasted to low signal 
rates (e.g., Kappauf & Powe, 1959), with the 
addition of noncritical signals (e.g., Weiner 
& Ross, 1962), with greater response com- 
plexity (e.g., Adams, Stenson, & Humes, 
1961), with dual-mode redundant tasks (e.g. 
Buckner & McGrath, 1961), with normal 
versus reduced ambient stimulation (e.g., 
Myers, Murphy, Smith, & Windle, 1962) 
and, of course, with more intense and larger 
stimuli (e.g., Adams, 1956). 

But, the literature is not wholly supportive, 
For example, Alluisi and Hall (1963) view a 


and 
in- 


1 Supported by Contract Nonr 3634(01) between 
Kansas State University and the Physiological 
Psychology Branch, Office of Naval Research, Wil. 
liam Bevan and Lloyd L. Avant are now at The 
Johns Hopkins University. 


Я iods 
decrement in auditory vigilance during Pearce 
of high multiple-task activity as pee 
against the theory, However, the eet re- 
control observations under a singles at- 
gimen, with the possibility of a late сео 
tendant decrement, weakens the significan ign- 
their argument. In contrast, Bakan and ctions 
ley (1963) report fewer auditory dete one 
in sighted than in blindfolded Ss. Нет ег 
may speculate, along with the authors, eo 
in terms of distractibility in the presenc or i 
more-difficult-than-usua] vigilance task in 
terms of greater-than-optimum arousal 1 
Presence of a complex task. In an expe ation 
designed Specifically to test the gir в 
theory, Adams and Boulter (1962) red onse 
their Ss to make a discrimination p 
under conditions involving different e 
tudes of head and eye movement (proP Т (ce 
tive feedback) and short-term memory < the 
tral feedback), However, when one €: paid 
overall task requirements and the use 0 nen 1 
5s, опе may question that the pM i 
Procedures effected significant differenc 
arousal level. pro 

A plausible alternative technique for ness 
ducing different prevailing levels of eet 
involves interpolating periods into the гер" 
toring program that may be assumed ". are 
Tesent levels of input or feedback га with 
effectively different from that associate p the 
the vigilance task. Studies dealing hc 
effect of interpolated activity already dao ve 
the literature. However, they have inVO te 
tasks of such varied complexity prese? 


men 
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under such a variety of conditions that their 
«Е Шйсацсе as operations for inducing differ- 
nt levels of CNS arousal remains obscure. 
fe example, in the pioneering monograph 
iier ш, Mackworth (1950) describes 
Poi Polating a telephone message at the mid- 

nt of the experimental session. However, 
» telephone message was an exhortation to 
Шы during subsequent testing. In con- 
of int IcCormack (1958) studied the effect 
ce ү Olated rest upon vigilance perform- 
Maga but rest consisted of reading popular 
клы and the opportunity to smoke. 
Vide] ingly, it was decided to select a simple, 
tects used type of vigilance task (visual 
24 ois and a representative signal rate 
а d hr) and to examine the effect of 
p ated periods of enhanced sensory in- 
i (prop tioceptive input from vigorous phys- 
( вене), of increased mental activity 
апа ng English words from four-letter 

Stams), and of stimulus deprivation (5 
vig © blindfolded and earmuffed) upon 
tion „С performance. Following the activa- 
two _¥POthesis, it was expected that the first 
e (ehditions would produce a reduction in 


ha Vigilance decrement and the last an en- 
ücement, 


METHOD 


һа ‘quirement crucial to the success of this experi- 
form, Mvolved identifying a task for which a per 
Pray nce decrement might be reliably produce 
lam "пагу observations were made with a single 
Beneg yn Unted behind a small aperture in à pena 
Whena black screen, S being requested to signal 
of i st he saw it illuminated. Different ине 
the ,"™ination were tried without success. Next, 
ask Was changed unsuccessfully to require w 
ар ч 9 the aperiodic absence of а pedo 
in an ins light, A satisfactory task was finally aem 
(1969 adaptation of a procedure used by Ba A 
the Which introduced an element of search in 1 
ligne Stting, The S was asked to report à flash о 
of а When it appeared at any one of the pum 
Breat, Square subtending a visual angle of кы М 
Коц St than 1°, The design was а simple mu ше 
the sign, Ss being assigned at random to еї 


; фоне а" соп- 
Чоо or one of the three experimental 


ns 


fto иеа. Four groups of 10 males each, 

State the Introductory Psychology course 
b Diversity, served as Ss. 

diy ratus and procedure. The Ss were 

table ally. The S and E sat on opposite 

Маср Separated from each other's view 
E Wooden screen. On S's side a wooden а] 


volunteers 
at Kansas 


tested in- 
sides of a 
by a large 
pron 
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extended from the screen to the edge of the table 
at an angle of about 30°. The visual display consisted 
of four 2-mm. holes at the corners of a 1-in. square, 
backlit by 6-V. signal lamps (General Electric 51) 
filtered through Wratten A-25 filters. The display 
was at eye level and approximately 20 in. from S. 
The duration of the signal was 3 sec. The schedule 
of presentation intervals for each half-hour period 
of monitoring was a popular one, first used by 
Mackworth (1950): į, 1, 13, 2, 2, 1, 5, 1, 1, 2, 3, 
and 10 min. in that order. The presentation of signals, 
including their duration, was programmed by means 
of Hunter decade interval timers. Their spatial loca- 
tion on successive trials was randomly assigned. 

Upon entering the dimly lit test room, S was 
asked to surrender his watch and then was seated 
before the display. He was told that the experiment 
was a study in signal detection and instructed to 
move a silent low-friction toggle switch from left to 
right whenever he saw a red light behind one of the 
small apertures in the screen. This action illuminated 
a small signal lamp on E's side of the screen and 
a response was recorded. After each response, S 
immediately reset the response switch to the off 
position. The regimens for the several groups were 
as follows: 


(a) Control: this group performed the monitoring 
task continuously for 90 min. and received a total 
of 36 signals. 

(b) Experimental-physical exercise: this group 
monitored the display for three 30-min. periods 
separated by two 5-min. periods of exercise, during 
which S was required to pedal a Sears Roebuck 
exercycle at speeds between 10 and 15 mph with a 
load setting of from 6,000 to 8,000 gm/cm torque. 

(c) Experimental-mental activity: this group 
monitored the display íor three 30-min. periods 
separated by two 5-тіп. periods during which S 
was required to supply one English word for each 
four-letter anagram presented. Two 25-item lists of 
anagrams were available for use during each work 
period. 

(d) Experimental-stimulus deprivation: this group 
monitored the display for three 30-min. periods 
separated by two 5-min. periods during which S 
reclined quietly on a cot, wearing plastic goggles, of 
the type worn by X-ray technicians but rendered 
opaque by several coats of flat black paint, and 
Willson sound barrier ear muffs, 


Each S's performance was scored in terms of the 
number of correct detections per 30-min. period, and 
statistical tests were performed upon these data 
Following convention in the presentation of vigil- 
ance data they were transformed to percentage of 
correct detections for presentation in Figure 1. ы 


RESULTS AND Discussion 


The vigilance decrement. Inspection of 
Figure 1 indicates a decrement in control- 
group performance across successive 30-min. 
periods of monitoring. While it is not as pro- 


100 


90 Combined Exp. 
во Control 


PERCENT CORRECT DETECTIONS 


1 2 3 
30-MINUTE PERIODS 

Fic. 1. Vigilance performance on Successive half 

hours of a visual detection task when observation 

was continuous (control group) or interrupted by 

5 min. of physical activity, problem solving, or 

reduced stimulation (combined experimental groups), 


nounced as that observed in some other studies, 
extending only from an average of 84% for 
the initial period to 72% at the end of the 
final period, it is consistent and thoroughly 
reliable (the F ratio for between periods in 
the control group — 9.69; with df of 2 and 
18, р < .01). Since the signals all fell well 
within the region of clear vision, were well 
above the chromatic threshold, and spaced at 
intervals minimally of almost a minute’s dura- 
tion, it is reasonable to conclude that the de- 
crement is associated with central—in con- 
trast to peripheral—mechanisms. 
Performance in the experimental groups. 
Examination of Figure 1 also quickly in- 
dicates two things about the influence of the 
several experimental treatments upon the 
vigilance decrement: they resulted in a 
facilitation of performance and Produced a 
decrement-free record p ratio for (Control 
versus Combined Experimental) x Periods — 
3.73; with df of 2 and 72, Ф < .05—and they 
did not differ among themselves in their effect 
upon the decrement—F (Between E's)x 
Periods (2/72)=1.03; р> 05. Thus the re- 
sults for the two groups experiencing inter- 
polated activity are in line with the hypothesis 


stated above while those for the one group 
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imula- 
subjected to brief periods of reduced € 
tion are opposite of expectation. e are 
data, which are consistent with a pese effect 
previous studies reporting a facilitating и 
for rest (eg, Jenkins, 1958; N quet 
1958; Saldanha, 1955; Solandt & Par! d 
1946), raise serious question for an pero 
tion of vigilance based on a simple Pty or 
relation between alertness and а теб 
amount of physical stimulation, irrespe is as 
whether or not level of мана tne 0 
sociated with the frequency, int activity 
duration of signals or with орон crement 
generated by the task. Indeed, a um an 
was reported by Whittenberg, pee. 
Andrews (1956) who required Ss b ushing 
to all jumps of the Mackworth clock, Piouble- 
a toggle switch in one direction for the eaii 
jump signals and in the opposite d 
for the single-jump nonsignal even ount for 
level of activity per se does not acc Baker's 
vigilance is further demonstrated by nce de 
(1963) observation that as performan Ei 
clined, general activity or restless 
creased, 


pental 

¿perimen 
A comparison of the three cin least 
treatments indicates them to have istic 1! 


one potentially significant раве Sa 
common: the interpolated period ri his 
change in an otherwise invariant ges to P 
Suggests variability rather than d igi 
the significant property of stimuli | al pri 
lance. Consistent with the physiologi¢ in the 
ciple of stimulation, Hebb (1955), system 
delineation of his conceptual pen bias vari" 
assigned great importance to stimu rs an 
tion for arousal, and Scott (1957), dn p 
tension of Hebb directly relevant to tified 2 
lem of the vigilance decrement, n (ie 
reduction in nonspecific stimulus ie input 
arousal) with S's continued exposure jike 
This he called sensory habituation. peautt" 
those of Kirk and Hecht (1963) ar iato 
fully tailored to fit the stimulus епа io 
theory of vigilance. Although the р, evel 0 
ОЁ a constant noise above the posue prob” 
the test room had no effect upon nonis 
ability of signal detection in a visual s e 
ing task, the addition of variable nois ced 16 
Same average intensity reliably enhan гочійё 
tection performance. This approach P apes 
ready conceptual accommodation for 
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of enhanced performance with multimodal 
redundant signals (e.g., Buckner & McGrath, 
1961), discriminable artificial signals (Wilkin- 
“on, 1964), and increased response complexity 
(eg, Adams, Stenson, & Humes, 1961). How- 
“ver, one is still faced with results like those 
тү йат and Boulter, Alluisi and Hall, and 
ttenberg et al., cited above, and of Baker 
«d Harabedian (1962), who found that the 
Simultaneous presentation of a second task 
ad no influence upon vigilance performance, 
sp, 9f Luce (1964), who observed that re- 
iom complexity had no facilitating in- 
uence, 
„А review of these last-mentioned studies 
vera the impression that in conceptualizing 
cha bility one must distinguish , between 
a and variety, that is, successively oc- 
tuni as distinct from simultaneously ре 
ро] 115 variation, The literature on in er 
e regimens, these last unequivocally 
f КОП as а technique for enhanced per- 
mance, is a literature dealing with change. 
ееш experiment by Gruber (1964) ш 
Pre: this point. Although the simultane bs 
yi tation of visual and auditory signa 
elded 4 generally higher level of name 
alter °ЇШег type alone, the Боба ва ci 
Кш between the two types produc vm 
ung Уу better level of performance t 5 
шып. апу other regimen including the uem 
Succe. , ^ ecOgnition of the importanc Na 
to „ive stimulus variation directs atten à 
im, € Incentive value of change; change : 
portant because it breaks the monotony Ез 
lan Petitive task. The observation Pi red нта 
Deri decrement and the salutary effe T at 
lodic Change in activity is reminiscen а 
tig Men's (192 8) observation of the pe 3 
tay ОЁ performance in a repetitive tas : 
ара recovery with a change in set. pid ie 
of ¢ are Butler's (1953, 1958) observato 


äp: 
© powerful reinforcement value that op 


Port g to varie! 


sti Unities for viewing or listenin bas Sed 
um. have for animals confined in C c 
i Visual or auditory environments. 3p e: 
T the vigilance setting are Бей gpa 
пег (1965, 1966) report of a reduc 
а е Я icipation of а 
errors of omission with anticipa 4 
aage from positive reinforcement for corri E 
*ctions to negative reinforcement for ws 
Vice versa. Tn addition, there are the o 
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servations of Smith, Lucaccini, pee and 

1966) that detection performance 
e ext D. Ж better when S monitored 
the display intermittently with an auditory 
cue marking the beginning and end of the 
vigilance period than when monitoring was 
continuous. Performance showed improvement 
rather than decrement throughout the test 
period. Furthermore, when the off periods 
were occupied by an anagram task, Ss greatly 
underestimated the duration of the vigilance 
task and judged it to be interesting. Relative 
to these results are the earlier data of Mc- 
Grath (1960) who reported superior visual 
detection with a background of sequential 
periods of music, recorded conversation, and 
mechanical noise, as compared to a continuous 
background of white noise and, of course, 
Mackworth’s (1950) enhancement of perform- 
ance following the interpolation of an ex- 
hortatory telephone message. 

With the recognition of the incentive 
properties of stimulus change we have come 
full circle to Deese’s view of arousal as an 
adjunct to expectancy theory. 
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WORKER PREFERENCES AMONG "TIME-OFF 
BENEFITS AND PAY 
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197 industrial workers expressed 


their preferences among 6 proposals for 


additional paid time off the job. Preference for a comparable pay raise was 


also measured. Extra vacation was m 


the workday was least preferred. The pay r 


i 1 lated to sex, age, x b à 
аш кеен 1 worker preferences with high accuracy. 


Foremen were able to predict overal 


The level of unemployment in the United 
м during the past decade has resulted in 
Pressure to spread the work by reducing hours 
liis per employee. This new emphasis оп 
о eon in work time is a continuation of s 
ihe | that stretches back to the emergence о 
We Industrial Revolution, when 16-hr. days 
ths not uncommon, The steel industry E 
A United States dropped the 12-hr. day only 
St v 3. The average nominal workweek = 
“adily declined, from 55 hr. in 1914 to 5 
: in 1920 (National Industrial Conference 
Stan? 1925). In 1938, the Fair Lahor 
wap ris Act defined the statuatory yo А 
of eat 40 hr. Continuing this trend, Loca | 
Wor € International Brotherhood of Electrica 
Б ета (AFL-CIO) in New York City 
Cured the 25-hr. week in 1962. While the 
“Or. workweek may be a long time comme 


gen А r that the 40-1. 
eneral use, it seems clea 60s than was 


into 
i 15 no more sacred in the 
S-hr. week in the ’30s. ice is 
vap ductions in work time have оба в 
n Tlety of forms, Henle (1962) reports p 
es Vacation increased on the cue ead 
1973 and paid holidays by 4 days 56% nas 
d 40 and 1960. Increased relief time; ea 
"trial sabbaticals, and paid early retiremen 
© accounted for additional reductions ш 
rx time, all without reduced wen та 
ba Vith automation and population н det 
x Ае, the trend to reduced hours ОУ. 
Pet employee will almost surely continue. : 
Orms it will take are, however, difficu Je 
Predict, Reducing the 12-hr. day wasa m E 
Tent goal in the 1920s than asa 
т extra paid holidays or early po 
д s prosposals to reduce the Б Зз 
© hot seem to enjoy the same clear абуап аэ 


ost preferred while a proposal to shorten 


aise was 5th in preference. Differ- 
marital status, and job satisfaction. 


when compared with a 3-mo. sabbatical every 
5 yr. or an extra week of vacation. In other 
words, the form that further reductions in 
work time should take may depend more on 
employee preferences than humanitarian goals. 

Yet there is no evidence in the published 
literature that employee preferences among 
the various forms of time off are being meas- 
ured directly. Industry negotiators often see 
their role as a reactive one with respect to 
labor demands, and as such they tend to place 
the responsibility for knowing what the 
workers want on the union. It seems clear, 
however, that most unions do not system- 
atically measure rank-and-file preferences for 
alternative forms of compensation. 

Nealey (1964a) used the paired-comparison 
method to measure the preferences of in- 
dustrial workers for six compensation options 
including more pay, increased vacation, hos- 
pital insurance, and more pension. Even 
though the options were of equal economic 
cost, they varied markedly in overall prefer- 
ence. In addition, significant variations in 
preference were related to demographic 
variables. In subsequent studies, Nealey (1963, 
1964b) confirmed that preferences for com- 
pensation options varied markedly between 
demographic subgroups, from plant to plant 
in a single company, and even with the level 
of job satisfaction. 

The present study used the methodology 
developed in these previous studies to measure 
employee preferences among a set of com- 
pensation options, all of which involve addi- 
tional paid time off the job. In addition, 
foremen predictions of preferences were com- 
pared to the actual preferences. 
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METHOD . 


The Ss were 210 blue-collar workers and 53 
foremen írom the parts department of a heavy 
equipment company located in a small town in the 
Midwest. The workers were randomly selected from 
among the approximately 700 employees on the 
first two shifts. The foremen group included virtually 
all foremen from the first two shifts, Responses from 
13 workers were improperly completed and thus dis- 
carded. Results will be reported for the Temaining 
197 workers (180 males and 17 females). All workers 
were members of the United Auto Workers (AFL- 
CIO); most were involved with order filling and 
parts handling. Wages were quite homogeneous 
across the sample. 

A paired-comparison questionnaire measuring 
preferences for six time-off and one рау option was 
administered by the authors to groups of 28-30 Ss 
each. Foremen were tested in separate groups. They 
were asked to complete the questionnaire as they 
though the workers would complete it, thus Providing 
a prediction of worker preference, Questionnaires 
were administered on company time; Ss were asked 
not to identify themselves, The worker question- 
naire also included Kunin’s (1955) faces scale, as a 
measure of overall job satisfaction, and five demo- 
graphic questions: sex, age, company seniority, 
marital status, and number of dependent children., 

The seven compensation options, as they were 
presented to Ss, are listed below, 
j A 4-day workweek of 9 hr, 

A 5-day workweek with shi 

7 hr. and 50 min. 


and 45 min. each day. 
orter working days of 


7 


6 F- Extra Vacation (.6/2) 


5 
4 
о " P 
ul 3E Five Fridays 4.3/3) 
x 
ü 2 
3 d Sabbatical (.134) 
ч 
E 
o 0 
z 
E «i 
2 Four-day week (-./22) 
=2 


Рау increase (-.217) 
E Early retirement (-.255) 


Shorter work day (-.465) 


Fic. 1, Relative preference for time- 


Off benefits 
and pay, 
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Five Fridays off per year with full рау т 
amounts to five 3-Чау weekends per uw duled. 
dition to any 3-day weekends already sc E year 
Early retirement by accumulating 5 days рё num- 
until retirement. Retirement age is 65 minus 

ber of days accumulated, with full pay con 
until age 65. 

Leave “of 25 working days with full ry 
5 yr. This amounts to 5 wk. off every 
addition to normal vacation, with full 
Additional vacation of 1 wk. per X25 jod and 
рау, to be added to present vacation per 
personal absence pay. 

Pay increase of 296. 


tinuing 


o-ht. 

Each of the six time-off options involves “action 
reduction in work time per year, with w 
in yearly salary (40 hr. equals 2% of 
year). The pay option involves a 2 
Thus, all seven of the options are of equa 
value. i 

The options were abbreviated for pai 
Parison presentation, The resulting x. a 
Options were arranged on the questions ich 
ing to the method developed by Ross (1 d 
balances right and left appearance of uw o 
and results in maximal serial separation 
within the list, i de 

In order to further control for Hnc В 
two forms of the questionnaire were Р ог» 
Of options were arranged on the two ted OT er 
right and left sides reversed and in inver 


ther 
the 0 
One form was completed by 99 workers, 
by 98. 


red-com 
pairs 0 


pairs 
wil 


Resutts AND DiscUssION 


197 
The preferences of the total group OF ats 
workers were scaled in unit normal a wee 
and are displayed in Figure 1. The = while 
of vacation was most highly preferre erence 
the sorter working day was last in pre ts ti 
The shorter-work-day option represen data 
off in its most fractionated form. d ins 
as well as spontaneous worker commer norte! 
dicate that a workday only 10 min. 
than at present may hardly represent 2 refer” 
The 2% pay raise was only fifth 1 f wet 
ence, falling behind even the 4-day WO" тре 
option with its 9 hr, 45 min. work к ар5 
4-day week with longer workdays is P ed. J f 
the most radical of the options prese? o be 


$ * г А : es " 
In even a fraction of situations it pre е Р it? 


T 
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‚шен number of times each option was 
EM by each S. One-way analyses of 
Wc were performed on each of the 
ae А; = Table 1 indicates, only in the 
dictions dim pay raise did the foremen pre- 
E ne significantly from worker pref- 
Шету е rank-order correlation between 
San. Scales is 90. The accuracy of the 
‘ited елап is remarkable when com- 
(1947 O several similar attempts. Raube 
) had employees rate the importance of 
biis factors. Considering only the top 
en ors, the rank-order predictions of 50 
iion ше correlated .30, and those of 42 
tatin olficers correlated .20, with the workers’ 
e of importance. The National Retail 
Bone Association (1939) reported that 
ors b ing of importance of eight morale fac- 
related 3,000 retail-stores employees cor 
Portan —.21 with the predictions of im- 
nce made by several hundred employers. 

p inability of management to predict em- 

i ES wants has become part of the lore of 
ы psychology. The accuracy of the 
emn in the present study would seem to 
à "s a reevaluation of this verdict. 
тер ne present case, both workers an 
— sponded to the same questionnaire, 
181 
Meet 


d fore- 
and 


nce there is some doubt whether these data 


ani. АП the assumptions underlying the use o 
using “Is of variance, е арав of results was analyzed 
Whit both analysis of variance and the Mann- 
fro Ney U test. The significance values resulting 

use of these alternative techniques were 
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TABLE 1 


MEAN WORKER PREFERENCES AND FOREMEN 
PREDICTIONS OF WORKER PREFERENCES 


io Workers € " 
ption ү = 197) | Predictions 7a 
( ) (N = 53) 
Extra vacation 4.53 4.24 1.82 
Five Fridays 3.82 3.80 .10 
Sabbatical 3.36 3.21 44 
4-дау week 2.67 2.98 .85 
Pay increase 2.45 3.26 7.64* 
Early retirement 2.34 2.06 1.25 
Shorter workday 1.82 1.36 3.54 
adf = 1/195. 
*p <.01. 


the options were specific and quantitative 
rather than general and qualitative. Whether 
union leaders and higher management, given 
the present methodology, can predict worker 
preferences as well as foremen remains a 
question for further research. 

Differences in preference associated with 
the demographic variables of sex, age, and 
marital status are displayed in Table 2. In 
general, preference for the more highly pre- 
ferred options did not differ very much 
from subgroup to subgroup. Ап exception to 
this was the tendency for the Five-Fridays 
option, which was second overall in preference, 
to be less preferred among older workers (5 
< 01). Males showed significantly higher 
preference for the pay raise than did females 
while preference for the shorter workday was 


Virt 
taie Ri 4 : ; 
Шы identical, Analysis of variance was me higher among females than males. Both of 
ions toe oe, it ке бв артй these sex differences seem readily interpret- 
n о і levels E f 
hitney y iut setting alpha able. Working women have traditionally been 
TABLE 2 
— MEAN WORKER PREFERENCES BY DEMOGRAPHIC SUBGROUP 
ae Age in years Marital status 
Option Se BS 
34-49 50-65 Single i EN 
сё | "ШР N 783 | W =б) (We) | = tT) 
3.53 3:39 eon 319 50 
EE ; RE 3.38 3.36 ‘OL 
ed B I 2.50 2.70 18 
у 252 nt 7? 2.50 2.44 102 
Show, retirement za; | 19 8 259 244 gaa 
т works 2165 | 4 2.50 1.72 5.23% 
ee SN. AN ua —— 


b 1/195. 
sIf = 2/194. 
+a? < .05. 
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TABLE 3 
MEAN WORKER PREFERENCES BY JOB SATISFACTION 


Job-satisfaction level 
Р - - p 
Option (Low) 1 and 2 | 3 4 5 (High) 
| &=23) | w= | (ев) (У = 23) — 
| - - m 
Extra vacation +52 +39 | — 460 | 4.87 325 
Five Fridays 3.96 3.86 | 3.97 3.09 `06 
Sabbatical 3.30 3.40 3.31 3.43 184 
4-day week 2.83 2.99 | 2.50 1.87 143 
Pay increase 2.39 248 2.22 3.09 1.08 
Early retirement 1.83 | 2.42 2.49 2.17 246 
Shorter workday 2.17 1.47 1.91 2.48 ч 
adf = 3/193. 
*p«.05. 
А ar of СГ 
less aggressive than men about wages, and formula for calculating. the nuber ariso® 
they may also feel that a job keeps them cular triads in a set of paired-comp?" ; 


from home duties too long. Preference for 
early retirement, as expected, increased sig- 
nificantly (p < .01) with age. This option was 
also more popular with married than with 
single workers. 

In addition to the demographic variables 
included in Table 2, preferences by seniority 
level, number of dependent children, and first 
versus second shift were investigated. Sig- 


nce by seniority 
osely, even to the 
abling them 
imilarity of 
ot surprising 
since these variables were correlated .68 in 
ns among all 
ables were not sig- 
t-shift workers did 


ays was sig- 


nificantly less popular among the most satis- 


fied workers. Differences in Preference for the 
shorter workday were marginally significant. 

If preference judgments of the present type 
are to be useful, they must satisfy the criterion 
of an ordinal scale, that is, they must display 
acceptable transitivity (Torgerson, 1958, pp. 
27-29). Kendall (1962, Ch. 11) provides а 


gat 
judgments. Circular triads serve as а ides a 
index of transitivity. Kendall also oe 5, as" 
probability distribution of circular random 
suming that preferences are purely Ss ro 
In 4,137 preference judgments the triads, 
duced a total of only 276 circular onds (0 
mean of 1.40 per S, This value iae thes 
а probability of less than .01 tha resent 
preference judgments are random. The P dina 
judgments may be assumed to possess 
scale properties, ated bY 
Order-error response bias was appe 
means of the x? test. The left-hand 0 137 
Were chosen in 50.549, ог 2,091, of t order 
Presentations (y? = 0.49, p= 50) 
error Was not significant in these Ae 
The results as a whole reinforce th 
clusion suggested by earlier research, @ 
Опе wage and benefit package will b "a 
acceptable to more than a зина, о wo 
ployees. This suggests the follow! :mallt 
changes in industrial practice: (а) jer th? 
rather than larger bargaining units pt otia" 
kind of flexibility in compensation ref 
tions that could be responsive to а choic? 
erences. (b) Some degree of individua enehi” 
in wage and benefit selection might ges ce 
cial. Various voluntary enrollment 205 ue 
and medical care programs offer this 
at present, but they usually involve rae on 
contributions. Offering comparable pens to 
a “cafeteria” basis would allow employ 
satisfy their preferences much more fu 


я t 
men 
duos. 
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aoe at present. Administrative require- 
the s ‚ of course, serve as constraints on 
im ues of individual choice possible in 
“a ipei For instance, in the present 
4-day a cec of Shorter workday, the 
ably i с, and five Fridays off, would prob- 
ašis Som to be initiated on a plant-wide 
sabbati me choice between pay, vacation, the 
айса], and early retirement might be pos- 


sib 
le on a self-selection basis. 
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ACCURACY OF MANUAL ENTRIES IN | 
DATA-COLLECTION DEVICES 


WILLIAM А. SMITH, Jn: 
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This experiment examined the accuracy of manually recorded messages similar 
to those encountered in field studies on the accuracy of data collection in 
production information Systems, The high efficiency in correcting errors 
ge Was recorded and the relative contributions 


kes to residual error found in field studies were 
sufficiently universal that they were геј 


The advantages sought in recording pro- 
duction data at the time and place an event 
occurs are improved accuracy of the data, 
improved System status and response to 


change in production activity, and Sufficiency 
of data. 


and super- 
visory review. The system accepting data 


tion phases. 


In so doing, it was necessary to define and 
classify the kinds of errors associated with 


1 This paper is adapted from a th esis 
the faculty of the Graduate Division o 
of Engineering and Science of New York University 
in partial fulfillment of the requirements for pe 
degree of Doctor of Engineering Science, 


accepted by 
Í the School 


The 
data collection in the shop environment c 
data collected in three different 1 ini jo 
Situations, one assembly shop and cteristics 
Shops, were analyzed and the chara They 
and quantity of errors were determined. 
fell into three major categories: ng fo 
1. Message format: Items with го from 
mat that can be detected and coin illegal 
System input (wrong message length; 
characters, equipment malfunction). уе col 
2. Message content: Items that ha ically 
rect form, but can be detected ae un- 
inconsistent (shop status сопа ко tries, 
usual quantities, corrections to goo" n): 
wrong machine or operator designatio уе cor 
3. Event description: Items that s ш 
rect form and are logically processable, ies 
Prove inconsistent after subsequent 
(omitted entries, extra entries, Lap с 
quence, late or early entries, failure 
rect detected mistakes). pe ide 
Messages containing mistakes can ted iD 
tified either at the time entry is шеш the 
ап input termina] or during proce yes 
data to update records. As an audit 


e^ 
ng 5 


are 
A x отр' 

tem accuracy, it is also possible ae ecords 
the results of routine processing wi ntory 


kept by parallel methods, with inne 
Status, or with predetermined test ent ing 


SX 10. 
Messages that remain inaccurate, conta’ 
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Mistakes which are undetected or uncorrected, 
after normal procedures of checking entries 
and utilizing the data are called “residual 
“rors.” They can be recognized only by the 
Special postprocessing analysis, or audit, 
mentioned previously. 


Fretp STUDIES 


siva ollection entries were studied inten- 

опа = three manufacturing shop situa- 

c ich were representative of production 

етай, nents and which afforded ease in 

Sites h ing recorded entries. In summary, these 
S had the following characteristics: 


E Assembly-line workers manually dialed 
at o Messages into modified telephone sets 
and ег individual work stations. Inspection 
en — Messages, varying 2-12 digits in 
in Sth, were recorded into similar sets at 
vidual stations. Time and station identifi- 
10n were automatically entered. 
tries n Tachine-layout operators recorded en- 
a, 1 а modified telephone-set terminal for 
E of machines (and workers) in a piece- 
Simi] Job shop. Inspectors made uidit in 
Vari ar devices at their work station. | е 
mist ble length and format entries required а 
assi ure of manually dialed digits and pe 
i 8ned job and machine identification cares. 
era and station identification Were auto- 
atically entered, 
ian this precision machine job вор, pr 
maj Поп and inspection entries were mà e ug 
tr "ly by clerks at a central production c | 
Ol station, A standard collection termina 
eng eted by a computer company was used Fa 
‘er 11 manual digits; preassigned cards 


containing part, shop order, and employee 
ntification; and time and date auto- 
matically, 
A of the distribu- 


ы ate representation с 
or e ate! 
Contained ge pov identified mis- 
akes are further characterized in Table 2 
Y the means of detection. “Entry” refers to 
*ecognition of a mistake while the worker is 
the input terminal. “Process” refers to 
Sonableness or status checks during data 
Processing, “Undetected” mistakes are oes 
entified only in postprocessing audits айе 
© data have been used. 


tion y category iS 


Tea. 


ow 


TABLE 1 


FIELD-STUDY Errors BY CATEGORY 


Error category 
Event 
Format | Content | descrip- 

tion 

Distribution of errors 50% 35% 15% 

Proportion detected 90% 659 20%, 

and corrected | 

Residual error rate 0.7% 1.995 1.8% 
of total entries 


The majority of mistakes were discovered 
in the field studies at the time of entry into 
collection devices and almost all of them were 
corrected as indicated in Table 2. These were 
most commonly format mistakes and obvious 
content discrepancies which are usually re- 
ported in describing error rates for data- 
recording tasks. The lesser number of in- 
accurate messages which escaped detection at 
entry resulted in the principal part of un- 
corrected error remaining in the data. Table 1 
indicates that logical and event-description 
errors were heavy contributors to the residual, 
or uncorrected and undetected, errors. Failure 
to record events, or omitted entries, proved to 
be a special concern in both the accuracy of 
the system and the design of processing tech- 
niques. Such inaccuracies are difficult to meas- 
ure in field studies and awkward to emulate in 
laboratory tasks. The residual error rate for 
messages containing mistakes after detection 
and correction procedures was consistent at 
slightly more than 4% of the total number of 


TABLE 2 
FiELD-STUDv ERRORS Bv SOURCE ОЕ DETECTION 
Source of 
detection Unde- 
tected 
Entry | Process 
Distribution of errors 64% | 21% | 15% 
Proportion detected and cor- | 97% 38% = 
rected 
Residual error rate of total 0.3% | 19% | 2.295 
entries 
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entries for production and inspection workers 
in the situations intensively studied. 
Individual workers displayed substantial 
fluctuation in the accuracy of recording in dif- 
ferent time periods. This was similar to the 
within-worker variation reported by Klemmer 
and Lockhead (1962). Thus, it was not sur- 
prising that significant differences were found 
in frequency of total errors in recorded data 
between different shifts in the same produc- 
tion situation and between different sites 
which used contrasted production-control 
methods. Comparison of residual errors, 
those remaining after normal detection and 
correction procedures, did not exhibit the 
Same statistical differences, They were not 
susceptible to influence by dissimilarities in 
Supervision, message construction, production 
control, or individual performance, Only obvi- 
ous discrepancies in recording procedures pro- 
duced statistically or practically significant 
differences in residual errors between shifts or 
production sites for the Steady-state situations 
studied. No clear preference was demonstrated 
for assignment of activity reporting duties 


among clerks, group or crew representatives, 
and individual workers. 


METHOD 
The Experiment 


The field studies were conducte 
ing environments Over which о; 
control could be exercised, Tt w: 
kinds and Írequencies of error: 
affected by unusual parameters 
were not easily 


ther, it 


d in actual operat- 
nly a minimum of 
as possible that the 
S encountered were 


or variations which 
recognized in shop conditions 
was dificult to 


ferent levels of 
form quantity and random 
n experiment 
conditions to oye 
spect to some par; 


Fur 
establish samples at dif- 
had the necessary uni. 
ness for analysis, 
was conducted under laboratory 
rcome these limitations with re- 
meters in order to: 

di Determine the accuracy of recorded messages 
and categorize errors, 


2, Analyze the effect of message 
cording time upon accuracy of dat, 
3. Characterize the ki 
takes made. 


length and re- 


numeric messages on a card-punch 
mistake was detected, $ was instructed 5 
message with an error indicat 
the entire message. 

Stimulus and apparatus. 


Sets of 60 randomly 
chosen data words for each 


message length were 


SMITH, Jr. 


A -in.-high 
visually displayed as black, handwritten, 2 aba 
numbers on a 4-in.-high white card. m group 0 
was singly presented simultaneously to d and they 
Ss. It was left in view while Ss recorde 


s sight 

ot in SIE 

Were instructed to ignore any epe existe 
at a particular time. Two sets of n lways 


were à 

for each message length. The pose each set 

ut were 
s ice sets 

only once in the trials. The same practi s were 


E " igit 
used for all Ss in all practice periods. Dig length 
meric 


for a trial at different message length. 
seated at normal height for a card punc 
had a clear line of sight to the stimulus. 
distraction were minimal. , Thirty right" 
Training and performance of subjects. duates Wee 
handed industrial engineering Unde previously 
tested in six groups of five each. All a% extensive 
used card punches but had no forma unch opera" 
training and no particular skill in ros s 1 
tion. At the beginning of each tria d correcting 
structions were covered on recording ап as use 6 
entries, A set of 20 two-digit numbers А set of 2 
illustrate these procedures. Then a separ timed СО 
two-digit numbers was recorded under uestions a 
ditions for practice and a period for dnd learning 
lowed before every trial period. Practice. се runs 41 
effects were minimized by these practic 
by randomization of factors. cac 
Variables. The number of errors for nt v 
60 recorded Messages was the depende 


h and ea 
Noise а 


ssion, 11 


h set of 
ariable- 


The independent variables were: digits. Thon. 
1. Message length, 3 levels—3, 6, 191 тозеп 
three levels of message length were "ep igi’ 


of the range of consecutive manually озне 
commonly used by system designers an , 
most commercial data-collection де. апа" 
2. Time for entry, 2 ушай а саш 
restricted time, Unlimited time to Sage ГЫ 
data and also time pressure generated died: | 
only 14 sec/digit for recording were stu ot five I 
3. Groups, 6 levels—6 different sets m grou 
dividuals. The Ss were assigned to the aali with! 
for all trials, thus nesting the individu 
groups. h 
Experimental design and procedures. ae 
tested in six trial runs conducted at Ир, gr 
over a 2-wk. period. The sessions for ; an 
Were randomized as to period of the day о, 
lime between trials. Within each trial ] message 
set of 60 display messages was run for Ee ae 
lengths in randomly assigned sequence, lished d 
sured that every permutation was accomp. assign! 
both time periods. The display sets We :mes 5 
SO that each appeared an equal number О: oup sd 
both periods of the day and that each rm pre 
exposed to both sets. The other factor, Ur inimi”? 
Sure, was assigned in a random manner to = atio? 
the possible repetitive sequences in prese 


d by 


al 
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TABLE 3 
ExPERIMENTAL DESIGN 
November 
Trial 
ane 1 3 4 8 10 11 
First peri 
period 
Group А B C E 1 D 
Display set т II I п e. " А 
"actor order of runs T-3 T-3 U-6 U-10 U- - i 
T6 T-10 T3 T-3 T-6 TA 
T-10 T-6 T-10 U-6 T-6 U-3 
Second period 
Toup B F D A E Cc 
"act T-3 -i - L 
“monier nf coti I n U-10 U-10 0-3 T-6 
E T-10 U-6 оз т-10 0-3 
Мр ы med panes ze unüimed rit: 3,6, i0 m-tiümiberofchar etes message. 
While Р à f the fixed variables identifed as message 
as: timed тоге 0 
m epe сот gop ban Bie lenci length, time pressure, or group performance, 
Ndividual Damned, TUA 20р ber ily selected Statistical test. Analysis of variance was chosen to 
fo 5, who were initially arbitrarily 


TOUDs, were assigned to different card punches 

p етеп positions relative to the display on 
wn 1Ссобвіуе trials. The design accomplished. is 
Was ua Table 3. The procedure for 2 trial session 
Bes t Tun a practice group of 20 two-digit ped 
cedures., illustrate instructions and correction a 
20 two. Without any time restriction. Next, a pen 
e ti -digit messages was copied on a time 1 

me restriction was imposed by: 


and reminding 


1, Ay 
t "nouncing th to be timed 
hi g the run to anid be made 


üt š 
Only An attempt’ to copy a message 5 
. E en the message was in view. 
Dump (E) timing expo 
3 


experimenter sure of each 


14 sec/digit. 
e to card and 
was kept 


er card by stop watch, allowing 
| he E standing with hand clos 
MS cards with alacrity. The watch 
©аг view of all Ss. 

were told they 
d to indicate if 
d to dis- 
after 


һа Contrast, on untimed runs, Ss 
the unlimited time and were asked t 
pk) "ded more time before E continue 
the t the next card, The Æ allowed & pause 
ast S finished recording each number. te He 
signe ‘tal runs were then conducted in : a isi 
process Sequences. Brief pane n ot те 
Were planned at the beginning о" ~ 
i det and a regular display intervals within them 
N low registration of punch cards. .—- T€ 
of ull hypothesis, No differences exist in the m d 
e КО Observed in recording visually disp! TAA 
A ~ ages, that is, ea, з, 0 = ёв, 0... Oh 1 ета 
B- Group A, 3 — 3-digit message, U — untime a Es 
TP Group B; F= Group Е, 10 = 10-digit messen 
` lime run. 
sel ernate hypothesis. 'The quantity 
ОЁ displayed messages is depende 


of errors in а 
nt on one or 


analyze this nested factorial experiment. Message 
length was а fixed variable with three levels; time 
pressure Was а fixed variable with two levels; group 
performance was а fixed variable with six levels; 
individual performance was a random variable 
nested within the groups. If message-length or group- 
performance differences proved statistically signifi- 
cant, Scheffé’s (1933) multiple-comparison test for 
contrasts would show that specific levels contributed 
to the differences. The total degrees of freedom, 
after removing 1 for the grand mean, were 179 
(5 Individuals per Group X 6 Groups X 3 Lengths 
x 2 Times). 

Significance level. a= .01, to ensure practical sig- 
nificance to any differences. 

Samples. The grouping and number of individuals 
were representative of the quantity of associated 
persons under shop conditions. Each S was asked to 
record 360 messages which represented activity of a 
production worker over a period ranging from a 
week to a month. The total of 10,800 displayed 
messages was substantial [or characterizing errors. 
The 179 degrees of freedom provided adequate 
sensitivity for resolution of differences despite the 
confounding of mean square error with expected 
mean squares for individuals. The number of ob- 
served errors was chosen as the measure because of 
the uniform quantity of displayed messages in each 


cell. 
RESULTS AND DISCUSSION 
Quantity of Errors 
The laboratory experiment yielded the re- 


sults shown in Table 4. All enumerated errors 
were observed in 30 sets of 60 desired entries 
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TABLE 4 
SUMMARY OF MANUAL EXPERIMENTAL ERRORS 


Message length 
E — [Overall 
3 6 10 
"Total errors 409 
Timed 26 69 122 217 
Untimed 28 58 106 192 
Residual errors 226 
Timed 12 48 827| 142 
Untimed 13 27 44 84 
"Total entries 3630 3650 3702 | 


for each cell shown. Although neither total 
nor residual errors responded to differences in 
time pressure on the individuals recording 
3-digit messages, there was practical signifi- 
cance to the quantity of errors encountered at 
different message lengths. The 3-digit mes- 
sages were apparently impervious to time 
restraint and displayed substantially lower 
error rates. 

The analysis of variance, shown in Table 5 
indicates that message length contributed 
very significantly to the differences in total 
errors observed. The effects of time pressure 
did not yield a statistically significant differ- 
ence in total errors committed, although 6- 
and 10-digit messages had noticeably fewer 
errors in untimed runs, Differences in per- 
formances by randomly formed groups were 
not significant, but this was again attributed 
to variation in performance of individuals 
nested within groups as indicated by the rela- 


TABLE 5 


ANALYSIS oF VARIANCE: TOTAL 
EXPERIMENT ERRORS 


Effect af | мз Е 

Message length (M) 2 | 127.239 | M, 
Time (T) | 3.472 TAL m 
Groups of individuals 5| 164459 | G/T 21 
Individuals within 24 | 22453 

groupe X 
MX 2| 1439 |MT/MT 
тхе i| 1339 ТЕА х Ls 
Mer 48| 3's23|MC/MI_ «1 
е „ЖРА 24| тові = 
x 686 
METXI ав | 4526 | МТС/МТІ <1 

179 
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tively large associated mean square. The mes 
sage lengths proved to be significantly d 
ent each from the other by Schefíé tests л 
multiple comparison. Thus, 6-digit messag® 
had significantly more errors than 3-digit pe 
sages at the 1% level. Likewise, p 
messages had more errors than did 6-08 


e for 
made 


ean 
а reasonably large contribution to ш Eo а 
Square, but this factor was countere! viduals 


the message 
we 

length contrasts by the Scheffé method и p 

dual-error 


аад М i error 
quantities. The difference in residual < pore 


significance at the 1% level. When this bat 
able was isolated from the production env 
ment, it proved to contribute to error 
ence. The choice of message length for 
digits, even in the short span of sizes 
Proved to be a substantial source of V 
in both total and residual errors. ze Sp De 
One individual S was an outlier Т 
performance, having quantities of tota m 
residual errors that were several Ыш Ве 
amount of the nearest competitor. No SP' E 


man 
studied: 
ariatio® 


Note.—F .001 (2/48) = 8.01. F.os(5/24) = 2.62. 
жр <.001. 


à е Ш 
assignable cause was determined for tP 
TABLE 6 
ANALYSIS ОР VARIANCE: RESIDUAL 
ExPERIMENT ERRORS 
Effect df | MS Д fed 
47 
Message length (M .506 | M/MI = 6 
Time (1) 18 (М) 1 | 18:889 | TTI n 
Groups of individuals (G)| 5 | 14.169 | G/I 
Individuals within 24 | 14.058 251 
groups T = Y 
MXT 2| 63721 MT/MTI Z 149 
TRG 5| 4.329/TG/TT <1 
MxG 10| 1859| MG/M. 
МХ 48] 2237 zii 
24 2.9 
MxT XG 10| 1:952 | MTG/MTI 
MXT XI 48 | 2.473 
179 8) 
2/8 
Note—FanQ/A8) = 8.01. Paou(1/24) = 5.72. P 
жр < оз. 


жж 2.001. 


ACCURACY OF 


MANUAL ENTRIES 
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TABLE 8 
CONTRIBUTION OF KINDS OF Errors TO RESIDUAL 


1 TABLE 7 
SUMMARY or EXPERIMENT RESIDUAL ERRORS 
Untimed | Timed Total 
Entri 
p 5508 5474 | 10982 
Ent 192 217 409 
“ntry detected 109 86 195 
ncorrected 1 11 12 
ndetected 83 131 214 
Residual 84 142 226 
ЧОТ rate (Рег. 1.5% | 2.6% 21% 
“аре of entries) 
Usual 


Slow ow rate, but the S was a poor and 
further ader, His recorded values illustrated 
tributeq the variability among Ss and con- 
Squares to the individual's within-group mean 
Was a hough this individual's error е 
Category," it was proportionately so in ea 


a imposed time limit did not seem to 
Booq any difference in the time to record a 
took r5 Both timed and untimed entries 
тоту Sec/digit ог less to record when m 
I bom detected or corrections attempted. 
ti; 5 obvious during the experiment that the 


© Pressure caused difficulty in correcting 


Experiment | Entries Residual | Error rate 
errors 
10982 226 21% 
Format 90 0.9% 
Content 127 1.2% 
Event 3 Negligible 


Therefore, it was not surprising that residual 
errors were more numerous when time pres- 
sure was imposed. However, the time pressure 
also allowed many more errors to go un- 
detected by Ss. It appeared to E that Ss 
worked with greater assurance under timed 
conditions, but this confidence was proved 
insupportable by the higher residual-error rate 
which resulted. 

In recording 10-digit numbers, 29 of the 30 
Ss reported that they developed a pattern of 
transferring digits from the display to the 
keyboard. Some varied the pattern used, but 
10 Ss recorded in two groups of 5 digits, six 
recorded in three groups of 4-4-2 digits, and 
seven utilized some combination of digits 


di А rouped 3-3-4. 
ipd mistakes. When no restraint was group 
Times ^ S was allowed to pace ae Sources of Detection 
lf, he frequently took double the -s А 
v digit vardet d order to make a Сог- The controlled experiment confirmed that 
ection and ranged as high as 5 sec/digit. errors detected by the operator during the 
© © 
TABLE 9 
Kinps or M. ANUAL MISTAKES: LABORATORY EXPERIMENT 
sage length 
Messag Total Mistake 
: Р 10 регсепї 
PRSE 05 05 E E 
Entries P 3650 3702 10982 
gistakes 50 122 223 395 100.0% 
ngle digi 
git 
Substitution 35 0 a7 a 
mission 7 A 1 13 18.5 
qp Sertion 4 13 16 23 5.8 
"Sposition 2 7 iE 29 73 
оцы E transposition 1 48 6.6 
е digits 
Substitution E $ Н ч 2.3 
missi = 1 4 1.0 
lon — = 
ipSertion = 4 2 2 0.5 
Scellaneous (including 1 ы 24 6.1 
Multiple-digit mistakes) 
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recording process were effectively corrected. 
Table 7 shows that only one detected mistake 
was missed in the untimed entries. The errors 
associated with the experimental recording 
were limited to format and content, except 
for an extra message and two omitted ones 
under the timed conditions. Thus, event- 
description mistakes, which contributed sub- 
stantially to residual error in site studies, 
were not included in the error rate calculated, 
The residual errors were distributed as in- 
dicated in Table 8. The proportion of entries 
that contributed to residual errors caused by 
format and content mistakes is similar to that 
found in the field-study and in other experi- 
ment data (Klemmer & Lockhead, 1962; 
Minor & Revesman, 1962; Scales & Chapanis, 
1954). The difference compared to the field 
studies lay in the lack of exposure to event- 
description mistakes in the experiment, Tt 
was presupposed that the number of content 
mistakes would be fewer in the experiment 
because misidentification and miscounts were 
not involved. However, no appreciable prac- 
tical difference was apparent. 


Nature of Manual М: istakes 


The mistakes observed in th 
experiment were analyzed to determine the 
kind of manipulation recording faults which 


in designing 
of data. The 
total errors enumerated here were only 395, 


revious tabu- 


SMITH, Jr. 


72 + 732 (where “+” is a сата ы 
dicate error detection and voids the p 
ing digits). 


| еб 
The mistake may be interpreted in on 
several principal ways: 


1. Substitution of a “2” for “3,” 

2. Omission of a "3: "gr 

3. Transposition of the “2” and " 
tected before entry of the last digit. 


«3? de- 


ible 
АП such mistakes were classified as. к 
transposition" to be consistent. ‘This 4 digits 
the presupposition that transposition 0 rding 
was the most common offense in Tomission 
data. Nevertheless, substitution and 95 dy 
of a single digit were the sources 0 kes em 
more than two-thirds of the gin than 
countered and were far more cere mis- 
transposition and possible transpositi e rela- 
takes. These results confirmed the Sa istakts 
tive proportion of kinds of digit messages 
identified in the completely manual m te 
in the field studies and have been repor trans" 
Carlson (1963). In the latter СӨЗ. lent 
Dosition mistakes were even less pl 
than in the experiment. 
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THE MULTITRAIT-MULTIRATER APPROACH TO MEASURING 
MANAGERIAL JOB PERFORMANCE 


EDWARD E. LAWLER, II: 


Department of 


The advantages of using the 
managerial job performance are C 
approach, it is possible to determine 
of ratings, and because of this co 
about the meaning of the ratings t 
single-trait approach were use 
sample of managers are analyzed and 


atings i ined. Encouraging d 
Oh еленови ae that ratings potentially can be valid measures 


In addition, several off-quadrant analyses are 
ooking at the disagreement among raters can lead to 
ga 


the rating process. It is 
blishing criteria where 


validity are obtained indicating 
of managerial job performance. 
performed that indicate 1 
further understanding of 


nsiderably n о 1 
han could be obtained if a single-rater or 
d. Multitrait-multirater data gathered from a 
the convergent and discriminant validity 


Administrative Sciences, Yale University 


multitrait-multirater approach to measuring 
considered. It is pointed out that, with this 
the convergent and discriminant validity 


more information can be obtained 


levels of convergent and discriminant 


concluded that this approach 
they are needed, either for 


E esta Ре i 
her advantages fox personnel decision-making purposes. 


research purposes or for 


у T а become increasingly stylish ш = 
cholo, Years to be critical of ворана pa 
ance 8y’s favorite measure of job ра n 

ordin tip superior’s global rating of dee 

out ate’s performance. It is often PO es 
ап that more objective measures are neo 
Ч that it is time to become more sophisti 

a іп performance measurement. However, 

is impressive pleas for new apiproacie, 

© superior’s evaluation is still the most tre 

аду used measure where criteria m 

р eded either for research purposes OF © 

"'sonne] decision-making purposes. That 1% 

€ther a criterion is needed against which 

: validate а test, measure the impact of a 

fe program, or whether а criterion 

eded upon which to base а promotion a 

y raise, the superior's rating is = = 
ris, Írequently used measure of es 
et For example, in Vroom's (196 ) > 

. the studies relating job satisfaction ат 

ШЫ Performance, he found that 16 studies 

1 Beant | 
"cuve Stade шене, Sterling Forest, N. Y. 


ik k C. 
ЗУ 1966. TI thor would like to than 
ABYris and L w. Porter for their helpful com- 
ents on an earlier version of this paper. 


er presented at the Ex- 


had used ratings while 7 had used objective 
measures of performance. A review of the cri- 
teria used for test validation as cited by 
Guion (1965) indicates that superiors’ rat- 
ings are used about twice as írequently as 
more objective measures and that peer rat- 
ings are seldom used. 

The superior's evaluation has probably en- 
joyed its greatest popularity at the manage- 
ment level. The reasons for this are obvious: 
management jobs are often multidimensional 
and hard to define; thus performance in them 
is difficult to quantify and make objective. 
This is not to say that attempts to get more 
objective criteria have not been made. Hulin 
(1962) and others (e.g., Bingham & Davis, 
1924; Gifford, 1928; Williams & Harrel, 
1964) have used salary as a criterion while 
others (e.g, Henry, 1948; Starch, 1942) 
have used organizational level achieved as a 
criterion. The problems with these indicators 
are in most cases even more severe than those 
associated with superiors’ ratings. Salary, for 
instance, is easily quantifiable, but it is a re- 
sult of a subjective rating to begin with, and 
then is furtherscontaminated by the economic 
market value of managerial skills and a num- 
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ber of company policies. Thus, it is not sur- 
prising to note that several studies have con- 
cluded that salary level in management jobs 
is not necessarily closely related to merit 
(Lawler, 1966a; Meyer, Kay, & French, 
1965). The same severe problems that exist 
for salary as a criterion are equally relevant 
with respect to promotion rate. As Stark 
(1959) has pointed out, promotion is a sub- 
jective decision that is made on the basis of 
factors that are often irrelevant as far as 
managerial effectiveness is concerned. 
Organizational decentralization offers the 
opportunity in many cases for companies 
to establish profit centers against which 
to evaluate a manager’s performance. This 
method does appear to have promise; how- 
ever, it will probably never be possible to 
evaluate all managers in an organization on 
the basis of their own profit center. In addi- 
tion, there is some evidence that unless profit- 
center measures and other obje 
are taken over long periods of 
be highly unreliable. Also, there is always a 
very real question as to whether profit and 
other objective measures are an accurate mea- 
sure of the goals that managers should try to 
achieve in order to perform their jobs effec- 
tively. Further, many objective and seem- 
ingly relevant criteria may be completely be- 


ctive measures 
time, they can 


They do possess some face validity and may 
be potentially very useful, However, there 
has been relativel 
lationship betwee 


О deemphasize the 
in managerial per. 
formance, while many management jobs ap- 
pear to emphasize it heavily, 

'The multitrait-multirater approach to mea. 
suring performance has received relatively 
little attention, but it appe. 


E ‘ars {о be poten. 
tially quite valuable since it has Some of the 


advantages of the more objective measures 
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and some of those of the more subjective pe 
For example, with this approach it E -— 
to assess the criterion by determining its ч s 
vergent and discriminant validity, aot indi- 
not necessary to depend on an objective p 
cator such as profits or sales that may res- 
the essence of the job. The focus of Шеп 
ent paper, therefore, will be upon bcd bo 
the potential usefulness of this approac yhere 
where research criteria are needed and cision 
Criteria are needed for personnel o wil 
making. In addition, some empirical da f this 
be presented relative to the usefulness 0 
method. e 
The first questions that arise Me] b. 
multitrait-multirater approach is uss multi- 
cern who is going to participate in o traits 
rater aspects of the approach and wha it as- 
are going to be included in the multitra ntia 
ресі. One must look first at the pet 
raters that are available for evaluating т con- 
Serial job performance, The obvious ot 
Straint here is that the rating should un d 
done by ratees who are unfamiliar wit 
aspects of the individual's performance te 
they are to rate, Otherwise, the ratings 
to be more likely to be affected by oF ten 
tendency (Bescoe & Lawshe, 1959) an raters 
to be unreliable, Thus, the most likely r, his 
for a given manager would be his spe 
Peers, his subordinates, and the manager each 
self. A good argument can be made tha view 
of these raters typically has an adeguati a 
of the manager’s performance, althous 
mittedly a slightly different one. -cluded 
Superior ratings have traditionally been ine pest 
because it is assumed that the superior has 
overview of the situation and knows best 
manager’s job behavior contributes to 
goals of the organization. ers are 
Peer evaluations are relevant because Pê orms 


fi 

best situated to evaluate how a manager ee to- 
in terms of the lateral relationships in ЖӨ рп, see 
ward organization goals. Further, peers ot view" 
the manager at times when his superior is D. see 257 
ing his behavior and, therefore, they may ris 
Pects of his behavior of which the superio " 
aware. jnat! 

Subordinate ratings are relevant since subord what 
are able to determine the superior’s impact ae e 
has been called by Likert (1961) the hum. also 
Sources of the organization. The subordinate rior s 
Often in a position to Observe more of his supe 
behavior than are either Peers or superiors. 


e overall 


É- 
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MEASURING MANAGERIAL PERFORMANCE 


Seli-ratings are relevant because the individual's 
fat perceptions are important determinants of his 
uture behavior, in addition to the fact that he 
Probably has more information about his own be- 
avior than anyone else. 


There are many potential traits that could 
€ used in the multitrait aspect of the ap- 
ү Unfortunately, there is no easy rule 
trait allows one to state that a certain list of 
йу 5 can always be rated reliably and val- 
is у. The evidence seems to indicate that it 
easy to err on the side of providing too 
oad traits upon which to make ratings. On 
and Other hand, as Dunnette (1963a, 1963b) 
а si others have pointed out, the concept of 
се Criterion is unrealistic, and job per- 
si ance is a function of a number of dimen- 
Ons so that one needs to think in terms of 
е criteria, The evidence from factor- 
ww Stic studies (eg, Ewart, Seashore, & 
os 1941; Grant, 1955; Rush, 1953) indi- 
inr, at somewhere around three to five 
mi is a reasonable number. The quum 
tr, Pains, however, as to the kinds р 
aits upon which ratings should be obtaine " 
i Че rating that probably should be included 
а global one on quality of job performance. 
s Statement is based partially upon, hit- 
V5 (1963)? impressive series of studies ОП 
* Dsychological basis of performance judg- 
ца. His data suggest that when people = 
M to make global ratings they oe 
of У predictable way, as efficient processors 
l Criticalincident data from their observa: 
lons of the individual's performance Over the 
Past 6 months. As Whitlock points out, 
paged quality of performance grows as a 
Power function of the ratio of the number о 
Pecimens of effective to ineffective perform- 
ance, Other studies have shown that zai 
end to agree upon the weight to be assigne 
to the different behavior specimens; thus, a 
тше reliability is possible. This sugges 5 
lat simple global-performance ratings em] 
Yield а reasonable approximation of wha 
Would be obtained by using а mor? extensive 
“titical-incident or other type of Сота 
he factor-analytic studies of ratings have 
SS 


uation through 


* G. H. Whitlock, Performance Eval ы устану: of 


Psychophysics. Unpublished pape? 
ennessee, 1965. 
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also invariably produced a job-performance 
factor. In addition, Hollingworth's (1922) 
data on what traits can be rated reliably sug- 
gest that performance dimensions can be re- 
liably rated. 

A second reason for including a global rat- 
ing is that it may help to reduce the halo еї- 
fect that often comes from overall perform- 
ance when other ratings are given. The as- 
sumption is that including the global rating 
allows raters to get their overall positive feel- 
ings toward the ratee out of their systems. 

The question of what other traits should be 
included in addition to a global one is diffi- 
cult to answer. The answer depends on the 
purpose of the study and on the particular 
types of behavior that characterize the impor- 
tant functions of the job. It may be necessary 
to develop partial criteria that are ratings of 
traits or factors like supervising, planning, and 
others which Hemphill's (1960) studies seem 
to indicate are the functions that make up a 
managerial job. The traits that are included 
should be clearly defined and carefully distin- 
guished from the global-performance measure 
and from each other. Perhaps one operational 
way of determining whether a trait can be 
specified exactly enough is to see if a behav- 
ior-description-anchored rating scale can be 
developed for it. Barrett, Taylor, Parker, and 
Martens (1958) have found that formats in- 
corporating behavioral description of scale 
steps were of superior reliability to numeri- 
cally anchored scales. One test of how ade- 
quately a trait can be observed and concep- 
tualized may be whether a behavior descrip- 
tion can be developed for the scale points. 
Smith and Kendall (1963) have used behav- 
ioral descriptions provided by employees as 
anchors for rating scales and they report that 
excellent discrimination and high scale reli- 
ability were obtained. Further evidence in 
support of adding verbal description to scale 
points comes from a study by Peters and Mc- 
Cormick (1966) which showed that job-task- 
anchored rating scales are more reliable than 
numerically anchored scales. 

One important perspective that has been 
too often overlooked where multitrait ratings 
systems are created is the development first 
of a theoretical point of view about what the 
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determinants of effective performance are. 
This does not mean a theory of whether per- 
formance consists of quality, productivity, 
turnover, or absenteeism, but rather atten- 
tion to a model like the one that specifies that 
performance = f(Ability X Motivation). This 
model points out that job performance has 
two components—ability (a) and motivation 
(m)—and suggests that unless separate mea- 
sures of these are obtained, errors are likely 
to appear in evaluating the effectiveness of 
ability tests and in evaluating the motiva- 
tional systems of organizations. For example, 
a study that measures the effects of a pay 
plan by including only measures of perform- 
ance (e.g., output, quality) would appear to 
be in danger of missing the impact of the 
Pay program. Output measures are affected 
by ability as well as situational factors and 
they might mask the increased effort the 
workers are putting forth under the new plan. 
The real test of the plan should be whether 
or not it increases motivation, 
A similar problem can occur in test valida- 
tion. Ability tests are often evaluated against 
output and performance measures alone with- 
out including measures of motivation. A situa- 
tion may occur where test scores are uncorre- 
lated with performance measures because mo- 
tivation is low. The model clearly points out 
that unless motivation is high, ability will not 
be related to performance. Thus, the wrong 
conclusion in this instance would be 


to as- 
sume that the ability measure is no good and 
to stop testing. A 


more realistic approach 
would be to keep testing despite low validity 
and to try to increase the motivational level 
of the employees so that the ability differ- 
ences will manifest themselves. Since there 
is considerable evidence (Fleishman, 
French, 1957; Lawler, 1966b; Vroom, 1960) 
that indicates the performance — f(a x m) 
model has general validity, this would ap- 
pear to be a good place to start. Specifically 
it would appear to be reasonable to get rat. 
ings on a few factors like effort and ability 
that are suggested by the model and to avoid 
the traditional approach of giving a long list 
of traits including such dimensions аз adapt- 
ability, friendliness, consideration, etc., which 
cannot be rated reliably (Hollingworth, 1922). 
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Some support for the belief that the pod 
factor is a reasonable one upon which to x 
tain ratings comes from the Ewart, oar 
and Tiffin (1941) study where an ability B 
tor appeared in their factor analysis of rat! 
scales. 


Use for Research Criteria 


At this point it seems appropriate to ps 
to the question of what the researcher ap- 
gain from using the multitrait-multirate one 
proach, and to present some data pono 
with the use of this approach in iam a 
research criteria. The primary gain d 
research point of view is that this арр! nore 
allows the researcher to develop a m ne ДЕЙД 
Sophisticated understanding of his eu ed. 
than is possible where it is not er y 
This understanding can come abani Pie dis- 
as a result of being able to determine spell 
criminant and convergent validity (Ca 
& Fiske, 1959) of the ratings? py the 

Convergent validity is demonstrated 


4 rated 
correlations between the same ban 7^ differ- 
by different raters being significantly dem- 


ent from zero. Discriminant validity validity 
onstrated by three criteria. First, à higher 
diagonal correlation value should be М8 


row 
than the values lying in its column pL 
in the heterotrait-heterorater triangles: ore 


is, a trait measure should correlate same 
highly with another measure of the vind 
trait than with any other variable nd, 4 
neither trait nor rater in common. e an 
trait measure should correlate higher WÍ trait 
independent effort to measure the аго ег” 
than with measures designed to get at r. For 
ent traits which employ the same rat ng i 
à given variable, this involves pes yall 
values in the validity diagonal with its Thir® 
in the heterotrait-monorater triangles. R 
it is desirable for the same pattern С the 
interrelationships to be shown in all ота 
heterotrait triangles of both the mon 

and the heterorater blocks. 


mult 

? Campbell and Fiske (1959) consider the multi 
trait-multimethod approach rather than mec out 
trait-multirater approach; however, they Ро? ania" 
that use of raters that occupy different Org bly 
tional positions relative to the ratee can I ont 
be considered to be measurement by more Ња! 
method. 


—  ———— M — — — À— —M—Ó 
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Campbell and Fiske (1959) point out that 
Most studies do not report criterion measures 
that even begin to approach all the require- 
ж ts for convergent and discriminant va- 
lidity. The major problem, however, at this 
Stage in the development of criterion mea- 
Sures for managerial positions, is not so much 
that ratings often fail to meet the require- 
RH for either convergent or discriminant 
Validity, but that in most studies presented 
їп the literature, it is impossible to assess the 
Convergent and discriminant validity of the 
Criteria used. Given this absence of informa- 
tion, it is impossible to determine if one set of 
řaters, or perhaps one trait, is performing 
Particularly well, and therefore should be the 
Central focus of the study. It is also difficult 
to eliminate certain traits or raters in order 
9 sharpen criterion measurement for future 
Studies. In effect, where either one rater 15 
Sed or where ratings are obtained on only 
Опе trait the validity of criteria must be 
taken on faith. Tf insignificant results are ob- 
tained, it is impossible to know whether the 
Problem lies in the criterion or in the pre- 
lictor. | 

It should also be pointed out at this time 

At it is possible for ratings to have —€ 
Yergent and discriminant validity and € 

9t be what would be normally called vali 

€asures of the dimension that is to be xp 
sured, For example, peer and superior fan 
1105 of a group of managers may agree рен 
€ctly so that convergent and cce d 
Validity are obtained. However, both tie 
Peers and superiors may be simply making 

* same incorrect inferences from observing 

€ individual's behavior. A manager my а 
*ldom in his office and rarely available E 
Meetings may be seen as low in mage 
the organization, in comparison бот 
ets, by both his peers and superiors- cmd 
‘ver, it may be that, unknown to the Te 
* is spending all his waking hours WO! m 
n an innovation that will significantly de- 

е organization. This would suggest that се 
Spite the existence of convergent and Gl 
Criminant validity for the ratings on ee 
mitment, the ratings would be invalid. kon 
Ever, it is probable that this kind of singt Е 
is sufficiently rare to permit placing conside 


oth 
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TABLE 1 


CRITERION INTERCORRELATION FROM ‘TUCKER, 
Crise, AND Ѕсимітт (1967) 


Superior ratings Peer ratings 


D; | As By Cy Di 


Traits 
At n Ci 


Superior 


EY 
Bi 


€i 


Di 


able faith in ratings that obtain convergent 
and discriminant validity. Still, this example 
clearly illustrates the point that it is impos- 
sible to ever finally validate a criterion. АП 
that can ever be done is to gain information 
about what it measures. 

With the requirements of convergent and 
discriminant validity in mind, two examples 
where the multitrait-multirater approach has 
been used can be considered. The first is 
shown in Table 1 and was taken from an arti- 
cle by Tucker, Cline, and Schmitt (1967). 
They had superiors, peers, and subordinates 
rate research scientists on four traits. Unfor- 
tunately, they did not report the correlations 
for the subordinates’ ratings, although they do 
mention that they did not agree with the peer 
and superior ratings. Table 1 shows that the 
peer and superior ratings do not tend to agree 
on the validity diagonal (circled correlations) 
highly enough to argue that convergent va- 
lidity exists. In addition, the data do not ap- 
pear to satisfy the requirements for discrimi- 
nant validity either. What is evident from the 
correlations is that a large halo tendency 
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TABLE 2 
INTERCORRELATIONS AMONG RATINGS 


Superior 
Traits 


| i self 
Peers ae 


EY Bi C, 


As В. Co As 


Superior 
А; 


В, 


С; 


Note.—N = 113, 


exists and that the superiors and peers are 
seeing quite different things, 

Admittedly, at this point the researchers 
are not on completely firm ground with re- 
spect to their criteria, but they can now make 
more sensible interpretations of their data 
than if they had used only one set of raters 


example, 
were interested in was creativity. Had they 
obtained ratings of o i 

have erroneously as 
they were measuring and 
their data showed that с 
related to creativity. 


cause multitrait data were collected, it is pos- 
sible to look further 


tivity. 
ie second example of the use 


of a multi- 
trait-multirater approach comes 


from some 


from 
data recently collected by the author -level 


a group (N = 113) of middle- and toP 


on. 
\ : nizat! 

managers in a manufacturing О obtained 
Superior, peer, and self-ratings Were per 


on quality of job performance, ability i. job: 
form the job, and effort put forth on o do 
The superiors апа peers were aske stand- 
rankings and these were converted 10 0510102 
ardized score equivalents of percent Fable 2 
for the purposes of the data analysis. se dat? 
presents the correlation matrix for the e pect 
It shows that the superior and mpi. it 
ratings have good convergent pepe ^ 
Shows that they meet two of the тавану 
teria for discriminant validity. The 5 found 
diagonal is higher than the correlation dotted 
in the heterotrait-heterorater triangles terrela^ 
lines) and the same pattern of trait rait tre 
tionship is shown in all of the hetero diffe" 
angles, even though there are some la 
ences in the general level of сог Js сг 
involved. The third requirement for dis o 
nant validity that the validity diagonal С 


tion? 
m 
rre" 


i 
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lations be higher than the values in the 
heterotrait-monorater triangles (solid lines) 
comes close to being met. This is a rather 
Stringent requirement which as Gunderson 
and Nelson (1966) point out is seldom met 
by behavior-trait data. The fact that some 
= idence for convergent and discriminant va- 
lidity has been obtained is a significant point 
Since it suggests that ratings of managerial 
Job performance can achieve a level of mea- 
surement that is aspired to, but infrequently 
obtained, 
A recent study by Gunderson and Nelson 
(1966) also obtained evidence for peer and 
Superior ratings on three traits that indicates 
п they obtained convergent, and to some 
mutent discriminant, validity. Forehand (1963) 
аз found that forced-choice ratings of in- 
an ive behavior show considerable me 
valine ee to convergent and oe baad 
ut that ratings obtaine 
tating scales do not. Fiske and Cox (1960) 
also have found that ratings on certain traits 
can achieve promising levels of convergent 
and discriminant validity. Thus, it would a 
Dear that ratings with a good degree 0 
discriminant and convergent validity шы 
© generally obtainable where well-deñnsi 
traits are used, where the raters have me 
Nowledge of the managers’ job psrfunünen 
Where appropriate rating scales аге ra 
ess encouraging are the self-ratinss Vena 
Presented in Table 2. These data offer | E 
evidence of either convergent or discrimin ү: 
Validity, as the self-ratings арреаг P. ie 
relatively unrelated to the superior rm de 
ratings, At this point the depo am E 
sa tion of not knowing how, won Der i 
rene йада. One possib ertheless valuable, 
View ing different, traits оп which superiors 
äna S of the um less charitable view is 
that peers agree. totally invalid. It is true 
i they are simply Z паз rather than, 
at the seli-ratings аге ТАГ f this they are 
Tankings and that because уз s 
Senerally inflated. Her tendency if the 
ша despite the ТЕШЕ angers stays the 
relative position of the 


has found some low 
M Kirchner (S ips between self and 
significan 


lationships Y 
Superior multitrait ratings; huweseu, Be id 
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TABLE 3 


MEAN SCORES ON DEMOGRAPHIC AND NEED-DIssSATIs- 
FACTION VARIABLES FOR THE Two Orr-QUADRANT 
Groups AND THE ON-QUADRANT GROUP IN 
SUPERIOR- AND PEER-RATINGS 


COMPARISON 
Lower by | Same by |Higher by 
peersthan | superior |peers than 
superior | and peers | superior 
(N = 33) | (N = 82) | (N = 32) 
Demographic 
variables T _ 
Time in present 42.4 37.4 64.5 
position 
(% longer than 
3 yr) К _ 
Time with com- 39.4 47.6 59.4 
pany 
(% longer than 
10 yr.) = 
Аве 36.4 56.1 71.9 
(% older than 
40) 
Education 66.7 60.0 53.1 
(95 with college 
degree) 
Needs 
Security (1 ques- 5 1.3 1.5 
tion) 
Social (2 ques- 4 5 8 
tions) 
Esteem (3 ques- S 8 1.3 
tions) 
Autonomy (4 8 14 1.2 
questions) 
Self-Actualization 1.0 1.4 L7 
(3 questions) 


not report enough data to allow the discrimi- 
nant validity of the ratings to be determined. 

The question of how subordinates’ ratings 
are related to superiors’, peers’, and self- 
ratings, of course, cannot be answered from 
these data. At this point it would seem to be 
entirely appropriate to focus on this topic in 
an empirical investigation. A reasonable pre- 
diction is that they would probably cor- 
respond more closely to the superior and 
peer ratings than to the self-ratings. 

The use of the multitrait-multirater ap- 
proach offers another benefit to the researcher 
Since it enables him to explore a potentially 
quite fruitful research area. With this ap- 
proach it is possible to begin to answer ques- 
tions such as: what are the factors associated 
with managers being evaluated differently by 
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TABLE 4 


MEAN SCORES Ох DEMOGRAPHIC AND NEED-Dissatis- 
FACTION VARIABLES FOR THE Two OFF-QUADRANT 
GROUPS AND FOR THE ON-QUADRANT GROUP 
IN SUPERIOR- TO SELF-RATINGS 


COMPARISON 
Lower by | Same by Higher by 
superior | superior | superior 
than self | and self. | than self 
(N = 40) | (N = 81) | (N = 33) 
Demographic | 
variables | 
Time іп present | 52.5 408 | ais 
position | 
(% longer than | 
3 yr.) | 
Time with com- 47.5 48.1 42.4 
рапу 
(Co longer than 
10 yr.) 
Age 60.0 54.3 45.5 
(^; older than 
40) | 
Education | 500 | 67.9 57.6 
(% with college | 
degree) | 
Needs | 
Security 1.3 03. | Ж 
Social | w | 6 | 3 
Esteem | ы | to | 6 
Autonomy | LX | 1.1 8 
Self-Actualizati L6 | 14 12 


their superiors, peers, and selves? This can 
be accomplished by looking at the off-quad- 
rants in the relationship between the di 
raters' ratings and lo 


quadrant groups (a low-high gro 
high-low group) and an on-quadr. 
were established for the relationship between 
the superior and the peer ratings, for the Fala 
tionship between the superior and the self- 
ratings, and for the relationship Eciweer the 
peer and the self-ratings. 


пр and a 
ant group 
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Table 3 presents the mean scores for E: 
two off-quadrant groups and for the опе а 
quadrant group where the comparison e 
tween the superior and peer ratings. The 
were gathered from questionnaires that =e 
manager completed at a group meeting pe 
the researcher explained that the data p 
being collected for a university "^ be 
project and that their responses wou! they 
confidential. As can be seen in Table 3; long 
Were asked to indicate their age, how еї 
they had been in the same position, 05- 
education, and their seniority. Where a 
sible, these data were checked with comp 
records and typically proved to be соо соп 

Table 3 also presents mean BREL areas. 
Scores for the three groups in five neee mally 
The 13 items used here are those orig 


го parts: 
used by Porter (1961) and contain o Pat 
The manager is asked to indicate on js now 
scale how much of a given factor there ask 
associated with his job, and then he is 4°", 
to indicate how much there A nk 1 
associated with his position. The n his 
that the larger the difference bet ings 
feelings of how much there is and his ne 
of how much there should be, the $ пит" 
the dissatisfaction, Thus, the larger action. 
bers in Table 3, the greater the dissatls ated їп 
Two trends appear їп the data prese! demo- 
Table 3. The first trend appears in ће dra 
graphic data which show that the ofan om- 
8roup which is rated lower on job PP riors 


higher by peers than by superiors. i 
off-quadrants appear to contain two nay be 
but rather identifiable groups. What t peer 
happening in these organizations is tha Л 
perhaps through a sense of rivalry, are organ” 
grading the young, bright lights in the s been 
ization. This tendency undoubtedly h4 ations 
accentuated in several of these a rts 
since they recently have made specia nager? 
to revitalize by bringing in new maring 
This finding suggests that when peer “isting 
are used in a situation such as the one €* 

in these organizations, an attempt shou they 
made, to consider the degree to which 
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reflect rivalries and resistance to new man- 
agers, 
The second trend that is apparent from 
Table 3 is related to the satisfaction data. 
hose managers who are rated higher by their 
Superiors than by their peers are better 
Satisfied across the need areas than are those 
Managers who are rated higher by their peers 
than they are by their superiors ( < -01)." 
n indication of the reason for this finding 
Can be found in the responses of the managers 
to the question of how much is there now, 
Which was asked for each of the 13 need- 
Satisfaction items. Analysis of these responses 
Showed that those managers who were rated 
higher by their superiors than by their peers 
felt that they were getting more in terms of 
heed satisfaction than were those rated higher 
У their peers, This, of course, would be 
expected in an organization, since the supe- 
riors control the opportunities that managers 
ave for obtaining many kinds of need satis- 
action, Apparently, being rated more highly 
У the boss than by one’s peers is not bad 
ecause one still gets rewarded, but being 
‘ated highly by peers and not the boss is 
disturbing because not only does one not get 
rewarded, one is likely to think that he should. 
able 4 presents the data from the com- 
Parison between the self- and the superior 
ratings, First, with respect to the demo- 
Sraphic variables, the off-quadrants appear a 
e characterized as being made UP of the 
extremes on the time dimension. The higher- 
Y-superior-than-self quadrant in розете 
to the lower-by-superior-than-self is ma e up 
9f the younger managers. (Time 1m wc 
is the only significant difference, P c ge 
Sain, what may be happening is tha fex 
Superiors are relatively more favorable tow <a 
their younger than toward their older suborc 
Dates. А 
Table 4 also shows that there is a tendency 


ег by 
291 those managers who are rated lower by 

Dry =: 

“А sign test was used in а manner ng БЫН 
done by Porter (1962). For each question ed 
Score for the lower-by-peers-than-superio gt den 
COmpared with the mean score for the equal group. 

n increase was considered а plus and а dec ce 
Was considered a minus. A similar Se с 
Made for the equal group versus the n sers 

an-superior group. Out of 13 questions 

2 pluses, 3 ties, and 1 minus. 


- 


TABLE 5 
MEAN SCORES ON DEMOGRAPHIC AND NEED-DISSATIS- 
FACTION VARIABLES FOR THE Two Off-QUADRANT 
GROUPS AND FOR THE ON-QUADRANT GROUPS 
IN THE PEER- TO SELF-RATINGS 
COMPARISON 


Lower Ьу | Same by |Higher by 
peers than | peers and |peers than 
self self self 
(N = 46) | (N = 68) | (N = 56) 


Demographic 
variables 
Time in present 56.5 
position 
(% longer than 
3 yr.) | 
Time with com- 54.4 441 47.2 
pany 
(% longer than 
10 yr.) 


38.9 


[^ 
es 
bs 


Age 
(% older than 
40) 

Education 30.0 73.5 52.8 
(% with college 
degree) 

Needs 

Security 13 

Social Fi 

Esteem 9 

Autonomy 1. 

Self-Actualization 1 


_ 


we Suk 


their superiors than by themselves to be more 
highly dissatisfied than are those managers 
who are rated lower by themselves than by 
their superiors (p < .05). An analysis of the 
managers’ responses to the two questions that 
made up the satisfaction measure shows that 
the difference between two off-quadrant groups 
comes largely on the managers’ answers to the 
question concerned with how much they 
should get. Those managers who were rated 
higher by their superiors than by themselves 
tended to have lower expectations about 
how much of the reward they should get 
than did those managers who were rated 
higher by themselves than by their superiors. 

Table 5 presents the data from the com- 
parison between the peer and self-ratings. Not 
surprisingly, since the peer апа superior 
ratings are substantially correlated, the results 
for the peer-self rating analysis are similar to 
those obtained for the superior-self rating 
comparison although none of the differences 
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Оп the demographic variables is significant. 
High satisfaction appears where self-ratings 
are lower than peer ratings, and low satisfac- 
tion appears where peer ratings are lower than 
self-ratings (p < 05). As was the case with 
the superior-self rating comparison, this came 
about because of the difference among the 
groups on the managers’ expectation of what 


tatings were 


ratings are made, Thus, 
be made that, in add 
convergent and discri 


ings, off-quadrant analyses should be per- 
formed. 


Implications for Personnel Decision 1 


So far the focus has been u 
gains to a researcher from usi 
multirater approach. There are also some ad- 
vantages in using it for Personnel decision 
making. Just as the opportunity to establish 
the convergent and discriminant validity of 
ratings is important for the researcher, it js 
important for the decision maker, This ap- 
proach allows the decision maker to gain а 


aking 


роп the potential] 
ng the multitrait. 
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. rs 
real grasp of the adequacy of the e 
ratings that have traditionally been ki ecta- 
a basis for personnel decisions. The к 
Чоп, therefore, would be that the oppo ng the 
to see the degree of relationship dei raters 
different trait ratings and the dip d 
ratings will add significantly to the ratings 
maker’s understanding of what the under- 
indicate. The result of this increased will be 
standing is likely to be that decisions eriors 
of a higher quality than if just eer 
ratings are relied upon. Further, ep ing off- 
maker now has the opportunity of d to an 
quadrant analyses which should lea factors 
increase in his understanding of the in his 
influencing Performance appraisal that are 
organization, Thus, the same gains m 
likely to accrue to the researcher fro to 
this approach are also likely to еше ap 
personnel decision maker if he uses t 
Proach, sional ad* 
There are several important adi 
vantages that the decision maker e tultirater 
is approach, that lie in the ни тах” 
aspect of the method. Personnel e trade 
ing is at best a rather complex set 0 


using 


subordinate, Peer, and self-evaluation’ muc 
of the trade offs inevitably will becom erhap? 
Clearer in Several important areas, fvation 4 
the most Important of these being dre i 
It is the stated Policy of most оа 
that they attempt to reward merit w! 


vi" 
а is also € 
raises and Promotions; yet there is al 


o nO 
dence that indicates many managers in thel" 
believe that 


merit is heavily rewarded 
organizations (Adams, 1965; айну. о 
One of the problems here may be tha gl 
izations have not taken careful eno m when 
count of peer and subordinate ре past. 
they have dispensed rewards in ac d 

very time an organization gives à г mething 
communicates to the members 50 ization 
about the payoff matrix of the отв ceptions 
Unless an organization knows the Phe other 
of all its members with respect to t 
members of the organization, it het 
e sure what it is communicating 
dispenses rewards. 

here is one final reason “т use 0 

quality can be improved through th 


грай" 


n never 


decisio? 


2 
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More than one rater. This advantage accrues 
from the fact that an individual’s peers and 
Subordinates are often in a better position 
to judge his performance and potential for 
Other jobs than is his superior. Thus, im- 
Proved decision quality may be expected from 
the additional relevant evaluations offered by 
Other observers. The evidence with respect 
to subordinate ratings suggests that they may 
е valid but the evidence is not extensive. 
Mann and Dent (1954) have found that sub- 
ordinates could identify some characteristics 
of promotable supervisors, and Patinka 
(1962) reported that less than 10% of those 
Superiors who were presented with their 
Subordinates’ ratings of them thought they 
Were invalid, 

À rather large body of literature has now 
accumulated on the ability of peer ratings to 
Predict other criteria, much of it contributed 
by Hollander (1954, 1956, 1957, 1964, 1965), 
and the evidence is consistently favorable. 
t has been demonstrated that after a rela- 
tively short period of time reliable test-retest 
Tatings are obtained. Williams and Leavitt 

947) have found that peer ratings were 
better Predictors of long-term success !n the 

arine Corps than were superiors’ ratings. 

Oadman (1964) has found that peer ratings 

ave validity as predictors of promotion ? 
TBM, and Weitz (1958) found that pect 
Tatings of salesmen during training correlate 
About 40 with superiors’ ratings once se 
Salesmen began work. Hollander (1965) an 
Others (e.g, Wherry & Fryer, 1949) ife 
cm established that peer ratings do not rene 
9 become popularity contests. F 
erhaps t» ges арол problem em 
Tespect to use of peer ratings for M di 
ecision making is the problem of the More 
Set versus the administrative set. Most о * 
Studies that have been done utilized the t 
Search set in getting their positive К dla 

good argument сап be made that i 
Tater knows it is “going to count, Г аз 
тау lose their validity, particularly if asl "i 
Чоп exists where an individual's self-interes r 
Might be best served by distortion of ШЕ н 
ratings. However, a study Ho КЕ Ё 
(1957) seems to indicate that peer rati A 
can be reliable and valid even when she 
with an administrative set. Undeniably, this 


is a topic that needs further research before 
wide use of peer ratings for administrative 
purposes would be advisable. 

Leavitt (1964) has pointed out that peer 
ratings (the same would also appear to be 
true for self- and subordinate ratings) can 
be an important tool for allowing participa- 
tion in personnel decision making, but that 
they will be effective only when integrated 
with a participative mood and participative 
practices in other areas. This relationship is 
illustrated and elaborated upon in Figure 1 
It shows that the validity and reliability ofa 
rating system for personnel decision making 
is not a simple function of the objective 
characteristics of the system, such as who 
does the rating or what characteristics are 
rated, but that individual differences as well 
as organizational characteristics modify this 
relationship. Under individual differences two 
dimensions appear to be important in deter- 
mining reactions to rating systems. The first 
dimension concerns the strength of the need 
for feedback and the second is the author- 
itarian personality dimension. Presumably the 
more need an individual has for feedback 
and the less authoritarian he is, the more 
acceptable will be peer and subordinate 
ratings. 

The assumption, with respect to organiza- 
tional characteristics, is that in a Theory Y 
or participative organization, peer, selí-, and 
subordinate ratings will be more acceptable 
than they will be in a Theory X organization. 
Attitudes toward the equity and acceptability 
of a rating system then are functions not 
only of the system itself but also of organiza- 
tional and individual characteristics. The 
final part of the figure shows that the at- 
titudes toward the system will dictate the 
validity of the ratings obtained. It is as- 
sumed that where negative attitudes exist 
among the raters toward the system, it will 
be impossible to get valid ratings. Perhaps 
the key point illustrated in Figure 1 is that a 
rating system does not exist in a vacuum and 
because of this no one system will be ap- 
propriate for all situations. 

If one assumes for a moment that it is 
possible to establish the kind of organization 
in which peer ratings and perhaps even self- 
ratings can be valid, then an off-quadrant 
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Differences 
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Attitudes менү 
ага Еа1г- 

Mus ne Ratings 

Acceptability 


Fic. 1. Illustration of the factors that affect the validity of ratings. 


analysis approach would appear to be par- 
ticularly useful. Such an analysis would 
identify those managers about whom con- 
sensus does not exist and then these appraisal 
differences could be openly considered. For 


be found, 
it could lead to a 
vidual has more con- 
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A COMPOUND-ATTITUDE SCALING TECHNIQUE 
FOR THE MEASUREMENT OF PARTISANSHIP 
IN LABOR-MANAGEMENT ISSUES' 


JOSEPH P. ZWEIG 


Sir George Williams University 


Measurement in the area of labor-manage- 
ment relations has engaged the attention of 
Several investigators in recent years. England 
(1960) has summarized a number of studies 
on dual allegiance going back to 1949. In 
some of these studies the method of measure- 
ment used by the researchers consisted of in- 
terviewer ratings of favorableness and un- 


ensive, time-con- 
suming interviewing of the subjects and sub- 
Sequent analysis of the Tesponses and is a]. 
most impossible to replicate. 


Another method involved the use of two 


1 This scaling technique was devised by the author 
n connection with a larger study Submitted to 
l'eachers College, Columbia University in Partial ful- 
illment of the requirements for the degree of Doctor 
Í Philosophy. The author Wishes to acknowledge 
he guidance of his advisers, Albert S. Th 
hairman of the committee, Robert L. Thorndike, 
nd Donald Е. Super. 


neutral or *in the middle" in their pue 
for siding with management and labor e 
taneously, This difficulty is further ane 
by the fact that the zero or neutral ow m- 
the Likert-type scale which was used Жл 
biguous and capable of various psycholog! 
Interpretations. 

Bernberg, Cole, Giedt, Peters, and v 
(1948, publ. in 1952) experimented with ШЕ 
indirect method, the error-choice techniq е. 
for measuring attitudes toward labor and co 
agement. In this type of scale the respon ү 
is offered two Choices both of which are if 
error. The choices are so designed that е 
there is a correct answer, the errors are i ke 
to fall on both sides of ‘it, "The princip de 
volved is that the perception and reca б 
objective data Will tend to be distorted by 
respondent to suit his predispositions. 

This work was үн тейпей F4 
Wechsler (1952). Balma (1954) " tiis 
Veloped a measure of management ident the 
tion based on this technique. Though ео 
еггог-сһоїсе technique offers the айкаша i 
Screening to prevent stereotyped response їл- 
has at least one drawback. The scores are 
ferences made not from the knowledge 9 ore; 
respondent but from his default. Bus 
the items are usually composed of 
informational material and therefore the ating 
also suffers from the diffculty of шор int. 
neutral scores from a psychological viewpo p» 

It would Seem reasonable that wid in 
tended to measure partisanship tendencie а- 
the stormy area of management-labo gine 
tions should be characterized by a distinc 
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live component of the attitude when it should 
be on the emotional component. 
К m short, it appears that a need exists for 
ае kind of labor-management partisanship 
Pes Such a scale should tap the emotional 
ins pi of the attitude. It should also per- 
E e identification of the neutral zone of 
Ores so that they can become amenable to 
Psychological analysis. 


PROCEDURE 


relate toversies in the field of labor-management 
rawn Tg EDAM as a rule in grievances which are 
officia] M the attention of management by some 
Such Tepresentative of the work group. Many 
е а ies are in fact solved at the level of 
not Med DOE and the shop steward, but some are 
Brievan EO through a series of steps known as the 
ап SRL procedure, These are generally settled by 
si itrator whose decision is binding on both 


е T 
5. The use of genuine grievances of this latter 


n Russet Works suspended operations for sev 
К Ог men were kept on for inventory check-up, 


de 
| We nen flavor. To use items composed 
E informational material of a noncontroversial 
ature is to put greater emphasis on the cogni- 

oh 


а 
@ А Company has the right to take inventory at 1 
related to production it is not obliged to fol 


з +2 +1 


agree 


agree more 
Strongl y d 


agree д 
than disagree 


moderately 


b 
® rd shut down which results in the relea: 
е company should follow seniority rules. 


+3 42 ы. 


agree 
Strongly 


agree more 


agree 1 
than disagree 


moderately 
establish construct validity the items wer? 
i ted to a team of five raters. By t É 
Were found to be unacceptable leaving 51 

hese 51 items were then arranged in the 
be à pretest to provide the data for the item 


lt 
em Analysis 
inque 8overning features of the item analysis are 
*d in the following steps: 


(a : : 
) Submit the pretest to crit 
(b) top-level managers and labor 
оц Eliminate those items on whic 
Ps agree, 


(c 
а) Select those items 


i l disagree in such a way as t 
Positi cement on either side of a cen 
ton of neutrality. 


erion groups of 
leaders. А 
h these criterion 


on which the criterion 
o maximize the 
tral value or 
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kind suggested the possibility of obtaining suitable 
items for a partisanship scale. 

Seventy-two case histories which met the require- 
ments for inclusion were assembled. In converting 
the case history to a suitable scale item, the core oF 
essence of each issue was extracted, reworded, and 
each case was presented as a condensed problem in 
industrial relations. 

Two possible solutions were framed and attached 
to each item as statement choices. One of these 
statements expressed a management point of view 
and the- other a labor point of view. These view- 
points were matched and balanced as far as pos- 
sible and were made to appear equally reasonable 
and justifiable but opposite in direction, 

Two six-step Likert-type scales were then at- 
tached, one to each statement choice. In scoring each 
item the ratings on these two scales were combined. 
By this device it became possible not only to tell 
when the respondent favored or opposed one side 
or the other, but also the degree of his alignment 
and the manner of his nonalignment or neutrality. 
Thus if a subject did not side with management or 
with labor, it became possible to state where he stood 
and by what means he maintained his position. 

Тһе following is an example of a typical item ex- 
tracted from the scale: 


eral days to permit the taking of the annual inventory. Several 
but senior men were laid off. The seniors complained. 


lowest cost to itself and since the work involved is not directly 
low the rules of seniority. 


-1 -2 -3 
disagree more disagree disagree 
than agree moderately strongly 


se of workers from work is a lay-off and under such circumstances 


-1 —2 —3 
disagree more disagree disagree 
than agree moderately strongly 


The item analysis brought the number of items 
judged acceptable to 20. In the final step the sig- 
nificance of the difference between percentages of 
managers and labor leaders who gave promanage- 
ment responses Was determined on these 20 items 
and the procedure was repeated for the prolabor 
responses. All of these differences were found to be 
significant at better than the 01 level. A comparison 
of the characteristics of the two groups on the 20 


best items appears in Table 1. 


Validity 

The items of which the instrument was composed 
are essentially drawn from actual industrial griev- 
ances. In this sense the scale possessed representa- 
tive, rational, or content validity. The statement 
choices attached to each item were judged by a 
team of raters to favor either labor or management 
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TABLE 1 


COMPARISON OF Scores or 60 M ANAGERS AND 50 UNION 
OFFICIALS ON THE 20 BEST ITEMS ОР THE PARTISAN- 
SHIP SCALE, BY PARTISANSHIP, DUAL AGREE- 
MENT, AND DuAL DISAGREEMENT 


y| x | sp 


| Капде 
| 
Partisanship | | | 
Managers | 60 57.8 | 18.9 23 to 113 
Union officials | 50 | —526 | 23.4 |—94t9 3 
Dual agreement | 
Managers 60 121| 87 0 to 36 
Union officials 50 13.5 | 10.6 0 to 42 
Dual disagreements 
Managers 60 2.1 3.3 Oto 8 
Union officials 50 26| 36 0 to 16 


* АП dual-disagreement scores were negative and the signs 
of these scores have been reversed to show absolute values. 


permitting the acceptance of one side and the re- 
jection of the other, the acceptance of both sides, or 
the rejection of both sides. These acts signified 
unilateral alignment, dual agreement, or dual dis- 
agreement, respectively, "These results were further 
sharpened by item analysis using known contrasting 
groups, Consequently, the instrument may be said to 
have construct validity, 

Finally, in order to establish Statistical validity, a 
criterion was developed independently by the use 
of the Remmers-Kelly (Kelly & Remmers, 1934) 
"Scale for measuring attitude toward any i 


Two copies of the Remmers-K 1I а 
а ter aa elly Scale, labeled 


е alternated to avoid respon 
Were administered anonymously to n 
Commerce Students in the evening 
George Williams University, Montreal, Concurrently 


ent of greatest Consequence js 


on Table 3, namely, Partisan- 
ship and Difference Scores, r= 64. , en 


Reliability 


Reliability coefficients of the 
agreement, and dual-disagreement 

?By permission of Н. Н. Remmers, Division of 
Educational Reference, Purdue University, Lafayette, 
Indiana, personal communication, July 13, 1962, 


partisanship, dual- 
Scores were com. 


puted from the data obtained for the 78 Comme 
students. Additional reliability measures were m 
tained from a tryout sample of 35 managers. 
coefficients are presented in Table 4. 


Scoring Procedure 


ch 
The scoring system vielded three scores M erii 
respondent, a partisanship score, a duo але 
Score, and a dual-disagreement score. The x align- 
ship score represents the degree of oe е 
ment. The other two scores represent n agrees 
extent to which the respondent agrees or Tess 
simultaneously with both sides on any of the " up 50 
For convenience the scoring system was EN posi- 
that responses scored as promanagement Wer! ative. 
tive while those scored as prolabor were negi 


1 А ‚ item the 
To obtain the Dartisanship score in Fal dbraically 
labor-statement choice score is subtracted alg These 


from the management-statement choice score. 
item scores are then summed. Я ent 
The dual-agreement and the dual-dissgre en 
Scores are each arrived at separately Br pairs in 
summing the positive pairs and the negative (m the 
those items in which the respondent man scores 
Опе ог the other, Since the dual-agreemo, scores 
must all be positive and the dual-disagrceme? {тот 
must all be negative, there can be no confusio 
this procedure, d to 
There is no zero point on the scales ope the 
cach of the statement choices thereby арш com- 
respondent to take a stand on each issue- a zero 
bining the two statement choices, however; ing of 
Partisanship score results from the summi 
equal or nearly €qual but opposite scores. sistently 
In the case Where a subject answers eon aie on 
his score will Show high partisanship, der otherwise 
Whether he favors labor or management. without 
it will show reduced partisanship with jo jtem 
dual agreement or disagreement. Since ea e total 
contributes д maximum of 6 points to И соге is 
Score, for 20 items the maximum possible possible 
120 points plus or minus, making a er for 4 
range of 240 points, This is ample provis! 
variety of response combinations. 


TABLE 2 " 
РР ION? 
PARTISANSHIP, AGREEMENT, AND INST! га АТ 
ATTITUDE Or 78 COMMERCE SIGUEN. 
Sir Grorce WILLIAMS UNIVERSIT 


vl x lsp Range 
100 
Partisanship 78 |274 |264) —58 10 4, 
Dual agreement 78 117.0 | 14.9 0 to 14 
Dual disagreement | 78 28 | 3.6 6 to 102 
Pro “Big Business” 78| 87 | 18 2 to 10.2 
Pro “Labor Unions” | 78 | 7.1 2:5 2. to 7.4 
ifference scoresb 78| i17 | 31] —6 


1005 
5 ne 8125. 
a All dual-disagreement scores were negative and d valor 
of these scores have benn reversed to show absol? “Lal 
Difference scores were obtained by subtracting 
Unions’ Scores from the "Big Business” scores. 
*› > 001. 


| 
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ү TABLE 3 
LIDITY COEFFICIENTS OF THE PARTISANSHIP SCALE 


Correlates N агза : 
Parti. Б 
та Нзіпашр and “Big Business” 78 .39* 
eese. and “Labor Unions" 78 —.54* 
sanship and Difference Scores | 78 .64* 


*» > 001. 


танны ы à | 
mees in Figure 1 indicates all the combina- 
sible on partisanship and agreement responses pos- 
: any si i A 
ing a single item, along with the correspond- 


T DISCUSSION 
i compound scaling technique described 
Vids i opportunities for a greater 
Scale Ae responses than the customary single 
ile preserving the general features of 

Such scales, 5 g 
combi using two six-step Likert-type scales in 
е a to form an attitude continuum, 
i wore responses can be distinguished 
Posite item assuming that A and В are 0p- 

ends of the continuum: 


(а) Favor А and oppose B: Siding with A. 


id Favor B and oppose A: Siding with B. 
Favor A and B simultaneously: Dual 


(d) agreement. 

Oppose A and B simultaneously: Dual 
T disagreement. 

in he combination of these responses result- 


n 1 s 
Some Om sometimes siding with labor and 


Etee, Ps with management in varying de- 
n from different amounts of agree- 
бе ЫЫ, disagreement, allows considerable 
dis bur in the nature and number of global 
tions which can be made. 
© of the advantages of the compound- 
€ scaling technique is that it makes 
three scores from the same set of 
Ship "Ses. In this case they were a partisan- 
dual, Score, a dual-agreement score, and a 
Њар ;, Sagreement score. Another advantage 15 
titude allows a tailor-made hidden neutral at- 
M t Zone to be built into the scale during 
to an uction while obliging the respondent 
Wig, © a stand on the issues in question. 
Sib], € type of item analysis used here 1t 1s 
€ to align this neutral zone with the 


€ scale. 


Partisanship 


Fic. 1. Scoring matrix. 


The neutral zone can be identified by first 
finding the standard error of measurement of 
an individual score from a knowledge of the 
standard deviation and the reliability of a 
sample of partisanship scores. Next, using the 
zero of the partisanship scale as a working 
origin, the interval containing two standard 
errors of measurement is determined on both 
sides of zero. This succeeds in establishing a 
medial interval lying half way between the 
extremities of the scale as the theoretical 
neutral zone. Ап individual's score must fall 
within this medial interval over 9576 of the 
time, if his true score is taken to be zero on 
the partisanship scale. 

Whether the zero on the partisanship scale 
is the best working origin to use as an anchor 
for the neutral zone is a matter which has to 
be taken care of in the construction of the 
scale. In practice any central value which lies 
midway between the actual mean partisanship 
scores of the labor and management criterion 
groups can be used with justification. If the 
statement choices in each item have been 
well matched and well balanced then this 


TABLE 4 


RELIABILITY COEFFICIENTS OF THE 
PARTISANSHIP SCALE 


| N | r Method 
Partisanship Е ý 
Commerce students 78 | .74 | odd-even corrected» 
Commerce students 55 "Ва | tést-retéstalter 6 wk: 


n corrected 


Managers (Tryout group) | 35 | .33 | odd 
Dual agreement 
Commerce students | 55 | .51 | test-retes 
Managers (Tryout group) | 35 | .64 
Dual disagreement? | 
Commerce students 78 | 42 


Managers (Tryout group) | 35 | .36 
| 


after 6 wk. 
| odd-even corrected 


odd-even corrected 
odd-even corrected 


a Split-half reliability coefficients corrected by the Spear- 
man-Brown prophecy formula. 

b The dual-disagreement distribution was violently skewed 
and the reliability coefficient is open to question since the 
arrays did not appear to possess homoscedasticity. 
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central value should fall very close to, if not 
actually right on, the scale zero position. 

With the medial interval, linked to a cen- 
tral value or actual zero, Serving as a crite- 
rion, it becomes a simple matter to distinguish 
those individuals who are “in the middle" or 
neutral from those who exhibit promanage- 
ment or prolabor partisanship. When the 
neutral attitude zone is defined in this way 
the medial cases which fall within the zone 
become available for further examination, 

In the major study conducted on first-line 
supervisors by Zweig (1964), from which this 
partisanship scale was extracted, it was pos- 
sible to separate a medial group of 85 fore- 
men into four more or less distinct subgroups 
classified as High Dual Agreement, High Dual 
Disagreement, Weak Partisan, and Nonparti- 
san. Only the Weak Partisan group could 
reasonably be characterized as neutral in that 
it tended to be impartial, lukewarm, or half- 
hearted in its support of one of the sides. The 
remaining three subgroups achieved mediality 
in a manner which, from a Psychological view- 
point, could hardly be characterized as neu- 
trality. 

The High Dual Agreement subgroup 
achieved mediality through what appeared to 
Since such cases involve 
simultaneous agreement with statement choices 


group achieved mediality through what may 
have been ignorance o 


е items and prolabor 
responses for the remainder. 


What appears to becom 
interpretation of the mi 
attitude scale to mean 
trality is not only super 
be incorrect. When the i 
cases is made possible by exposing the neutra] 
zone as defined above, 


Several other Ways of 
attaining mediality may emerge which have 
little to do with imp: 


1 artiality 9r neutrality. 
This kind of analysis is not readily available 


through conventional scales, 


€ evident is that the 
ddle position on an 
impartiality Or neu- 
ficial but may in fact 
nvestigation of medial 
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be 

The partisanship scale also аррей Aa 
able to discriminate between m ina à 
groups as top management, foremen, Апа] 30° 
ficials, and commerce students. The ceptable 
strument was found to be very ac oversial 
in use even though it dealt with contr set, it 
issues. Although no time limit ee 
rarely took over 20 minutes to comp! п Tabl 

The reliability coefficients shown * 
4 are not all that may be desired, 
may be enough for group prediction. 
further validation is necessary, Th 
validity coefficient is encouraging. D 
tion suggests that the partisanship 1 of the 
tapped by the scale is the еш rolabor 
difference between a subject’s actua r е use 
and his promanagement iudi 
of items composed of controversial Р in tb 
grounded the partisanship attitu в other, 
Subject’s attachment for one side or hich may 
rather than in his belief system W ality: 
reflect tendencies toward convention пей fot 

The scale described above was ee 
research purposes in industry. Pond an 
technique is flexible, brief, and be applied 
there is no reason why it may not ina V 
for research or practical gp exist ОЛ 
rlety of areas where opposing view: 
the same issue, 


e 
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43 major corporations pro 


tions were found both in the г 
relations department and in tl 
activities is centralized at the corpora 
ing units of the company. Indexes 0 
seemed to be in agreement wi 
consistent and significant di 
specific industrial relations activi 
typically centralized, 
promising scale for t 


activity level in the industrial relations f 


jen each company must shape its in- 
icu 24 relations function to suit its own par- 
e s local needs and situation, it is desir- 
MEO time to time to evaluate how this 
Pariser. is being discharged, either by com- 
e 4A With other companies to determine 
араай of divergence from the common 
With, Th, or by manipulation of internal data 
ү comparison. qun 

re intercompany or  interindust 
Provide arks are available the evaluation will 
e * a more realistic appraisal than would 
Possible in the absence of such benchmarks. 
йш} recognition of the desirability of creat- 
enchmarks for comparative purposes, the 
Ustrial Relations Center of the University 
Minnesota, under the direction of Dale 
ег, undertook an annual survey of salaries 
Staffing ratios in industrial relations. In 
a, Petween 1949 and 1962, when the puit 
lish, abandoned, 13 annual surveys were pub- 
ed (Nelson, England, & Yoder, 1963)- 
"s Central statistic developed was the per 
em "a ratio (PR): the ratio of the number * 
emp Oyees in industrial relations to the tota 
ployment in the company. This ratio has 
| Ж idely used in industry to assess the 1n- 
ine relations function (Mee, 1958, р. 
As Gray (1965) and others have 
d out, however, the PR provides less 
unambiguous information. The ratio 
may be correlated with company size 
merican Management Association, 1961, 
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D P sociation, 
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vided data on organization structure and 
1 relations activities scale. 
ange of activities undertaken by the industrial 
he extent to which responsibility for these 


and responses to a 38-item industria! 


he measurement 0 
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employment, 
Wide varia- 


{ activity level and activity centralization 
th reported po 
fierences with respec! 
ties (e.£ ) 
time and motion study is typica. 


t to centralization as among 
union contract negotiations are 
ly decentralized). A 
f organizational centralization and 
unctions has been developed. 


Table 12; Nelson, England, & Yoder, 1960; 
Wortman, 1963), limiting the possibility of 
applying an average industry figure to evalu- 
ate the industrial relations functions in dif- 
ferent-sized companies. 

Furthermore, the number of employees in a 
function such as industrial relations is not 
necessarily a very good indicator of what they 
do, considering the wide range of possible 
activities in the function. 

A more sophisticated statistic to evaluate 
the industrial relations function (or any other 
corporate activity, for that matter) on the 
basis of comparative work-force data is a 
regression equation including the predicted 
number of employees in the function as the 
dependent variable, and total employment 
as the independent variable, namely, 


IR=a+ bE 


where IR is the predicted number of em- 
ployees in industrial relations, E is total em- 
ployment, and a and 5 are the constants. 

It may be noted that if the linear relation- 
ship € exist, it follows that the PR system- 
atically varies with total compan - 
ment: иде кшш 
IR employment 


PRI 
Total employment 


_ at bE 
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data, etc, 
Merrihue & Katzell, 1955). T 


res of industria] 
аге combined 


Pany comparison and, indeed, the pi 
impossibility of maki 


versus decentralization, 
Forty-three 2 major cor 

lengthy questionnaire, dat. 

and on genera] empl 


ers; the median was 16,000. The 30 other Companies 
were distributed among 12 manufacturing industries 
and reported total employment Tanging from 11,400 
to 38,000 employees; the medi 1 


2 Not all companies reported complete data, For 
each variable, the number of responding companies 
is shown in Table 1. 
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" loy- 

30,000. For the sample as a whole, median emp | 
ment was 26,950, on 1 

A correlation analysis was made of -€— also 
Variables, and measures of епк Нон ES jon 
Compared with qualitative data on cluded: 
Policies and practices, The 11 variables i ms 

First, three measures of employment 


(1) total employment, 
(2) total industrial relations staff, jal relations 
(3) headquarters or corporate industri 
staff. ted, but 
ed; 
Total headquarters work force was also no 
not treated as a separate variable. 


105: 
Second, two traditional personnel rati 


io (in 
ы ] ratio 
(4) total industrial relations ye pro oyment) 
dustrial relations staff to total " 
and А ersonnel rati 
(5) corporate industrial relations шә; í 
(corporate staff to total employ a based 
-— f sta. 
Third, two measures of centralization 0 
upon employment figures: 


Р tions sta 
(6) the ratio of corporate industrial p 
to total industrial relations staff, base * е 
а personnel concentration inde о with the 
comparison of the previous p> total wor 
ratio of total corporate staff 
orce, . the in- 
This index measures the extent to Bg e concen- 
dustrial relations function is more oF re all 9 
trated at the Corporate level than а 
company functions, 


seated 

indicate 
For each item, the responding Cod administet 
that (a) the Corporate staff ашы ы (0) us 
the activity (eg, labor negotio ene the © 
Corporate staff reviews and approves, 
Porate staff provides advice and ЕР be 
the activity is not a corporate pe in t 
there is по active program in the 
company, 


^ re are: 
The two measures based on this sco 


с 
1 only, (e 


d 
base 
ore 
(8) an activity centralization index, а 5© 
Оп the first four response categories. - ac 
5 
This score сап Vary from 0 (none of r5 4 n 
tivities is 4 Corporate responsibility) d, and ? 
activities centrally located, conducted, 
ministered), and activitie? 
(9) an activity ratio—the number сете for 8 
coded to reflect corporate responsi , 0f 
least advice and counsel (Codes а, 
checked), divided by 38. 


с 


1, 
jon? 

е fessi. al 
Finally, two measures of the ratio of D cleri 
technical, and manageria] (exempt) staff 
(nonexempt) staff: 
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TABLE 1 
MEDIANS, QUARTILES, MEANS, AND STANDARD DEVIATIONS FOR ALL INDUSTRIAL 


RELATIONS (IR 


) MEASURES 


No. M 
Measure responding E SD Q1 Mdn Q3 
companies | 
1. Total employment 43 32826 | 40647 | 14801 | 26950 | 31548 
A Total IR Staff employment 28 284 334 100 E E 
n Corporate IR staff employment 37 35 af 955 0.85 112 
_ Total IR personnel ratio 28 1.01 0.59 e Jan En 
6. Corporate IR personnel ratio 37 0.11 E оэ dan 1300 
7 p Porate IR staff to total IR staff 26 16.00 3:66 2.66 4,55 697 
& дезе] Concentration index 5 $5 | oss | mel 172 | 193 
E T ie та 12 1020 | 1930 stoo | 7490 | $2.90 
11, -Xempt/Nonexempt ratio: Total IR staff 26 ju Hed 115 eH 002 
i stag P Nonexempt ratio: Corporate IR 26 j 3 
| | 


ч) the exempt-nonexempt ratio for the total 
industri Á f d 
(п) ih Strial relations function, an 


the exempt-nonexempt ratio for the corporate 
Industria] relations function. 


RESULTS 

ables 1 and 2 summarize, respectively, 
on cures of central tendency and dispersion 
amo € 11 variables and the intercorrelations 

р ЕЁ the variables. | 
"ibloyment and the personnel ratio. While 
Corre] Тее employment-size statistics are uud 
Dect ated with one another (as might e 
exten? they are related to only а Ши 
те ПЕ to the rest of the measures. The ‹ 

“tions of total employment with the various 


ratios and indexes are all insignificantly dif- 
ferent from zero. It might be noted that the 
correlations between total employment and 
both PRs (total PR and corporate PR) are 
both negative. At least in this sample, as 
company employment size increases, the PR 
tends to decrease. The absolute size of the 
corporate industrial relations staff, however, is 
positively related to the corporate PR. 

Total PR and centralization, The total PR 
is negatively correlated (—.40, —.38) with 
the two measures of centralization (personnel 
concentration index and activity centralization 
index). Decentralized companies, in other 
words, tend to have larger industrial rela- 


TABLE 2 
INTERCORRELATION MATRIX 
A E = 
DEN Variable 
Variable 2 3 4 5 6 7 8 9 10 11 
1 Tot s9 71 —08 —15 —10 18 12 03 —17 —16 
2. petal employment — 72 36 —03 —16 —00 —05 —02 -25 -25 
3. Total IR staff employment 08 51 39 18 31 22 -19 -23 
4 Torate IR staff employment = —20 —06 —40 —38 —10 —30 -09 
5 ү personnal E V = 71 02 20 25 04 —18 
6 ate егѕоппе! — 5 
2 porPorate IR Ма to total TR staff E co E D E 
8, 4 Sonnel concentration index ея 53 06 30 
9. А Clivity centralization index — 12 10 
Ig. pctivity ratio = 35 


1p Ххетрі/№опехетре: Total IR staff isl 
„| Xempt/Nonexempt: Corporate IR $ 


Note.—Decimal points omitted. 
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tions staffs in relation to their total employ- 
ment than do companies in which the in- 
dustrial relations function is more central- 
ized at the corporate level. 

Centralization and level of activity. Cen- 
tralization of functional responsibility at the 
corporate level (activity centralization index) 
tends to be related to a wider range of in- 
dustrial relations activities (activity ratio; 
r= 53), and both functional centralization 
(activity centralization index) and a wider 
range of activities (activity ratio) are as- 
sociated with larger corporate staffs vis-a-vis 
industrial relations staffs (7 = 44 and .50 
respectively). 

Exempt-nonexempt ratio. Contrary to orig- 
inal expectations, the ratio of exempt to non- 
exempt personnel did not seem to be related 
to any of the other indexes or measures that 
Were computed. Organizations that have fairly 
well-centralized industrial relations programs 
are about as likely to have low exempt-non- 
exempt ratios as high exempt-nonexempt 
ratios, and decentralized Programs reflect 
similar variety. It had been thought that as 
industrial relations programs increase in size, 
extent, and variety of functions, and degree 
of centralization, the ratio of exempt to non- 
exempt employees would go down because 
larger numbers of clerical people would be 
required to accomplish all the details of ad- 
ministration. This hy, 
tially sustained 


? 


(the steel 
ghtly higher 
elations central- 

nonsteel com. 


industry is characterized by a sli 
tendency toward industria] r 
ization—median 1.83—than 
panies—median 1.53). 

To test the index against тапа 


ы еМ gement per- 
ceptions of centralization, 


respondents were 
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А ; extent 
asked for their views concerning the 


va г 
to which industrial relations activities uia 
should be, centralized at the company ctivity 
quarters level. Companies with high a that 
centralization indexes generally герог Jeading 
the function was centralized, and the ity 0 
reason cited was the need for bpm c 
action arising out of master labor d score 
For example, a steel company wit 
of 2.69 said 


А need fo 
+ + + from our experience there is а Pies 1 
a close review and approval of the С 
through a central staff functioning at 
Company Headquarters. Unless this ЕТИ 
сап be misinterpretation of policies n 
ultimately go far afield of the origina d this t° 
intent of such policies. We have foun erations an 
very definitely the сазе even where ОР! create ps 
closely integrated. It is very easy s ZmploJ^ 
Understanding involving such quaere у throug 
Benefit Programs (insurance and pensi 

wrong interpretations at plant levels. in 
can be corrected quickly where gener 
is established through centralize 
staff. . . . In certain areas such а= 
to safety, the actual operations must Howeveh i 
at the plant and departmental levels. depend Ps 
Ereat majority of the other activities ies е 
marily on strict interpretation of ae shou йа 
lished by top management and there cat effect! 
administered from headquarters to be ™ 


nt 
purpose fv. 


ied 0 
be came he 


3 
of 2. 
A nonsteel company with a score 

said fields 
any other “the 


In the Industrial Relations or desirable., 


decentralized administration is highly rtan 
central group can provide three impa nce all 
Company policy manuals to give IM m 
administrators; 5а] assistance (espern ee are 
plants) in the development of ia which 75; 
manuals, training material and the b riodic а 
beyond local plant staff capacity; a шала 
Or inspections to provide assurance so has not іт“ 
ment that decentralized administration ry ute 
sulted in failure of a location to ca” 

Я ieies js 
portant Company policies А control di 
pretalt e 
play! ase 
d 7$ 


We find that a high degree of centra 
necessary in the negotiation and inte 
contracts (to prevent the unions пош à 
plant off against another) but that mos tion 
are best handled by local administra 

Sponsibility within broad policy limits. { 


ВИ, 
However, companies with somewhat ization 
problems, but with low activity cent istr ү 
indexes, tend to deemphasize admi audi 
consistency and to emphasize reporting: 
ing, and counsel. 


жо тшшш л ——_ өөө ө ө өӨөӨ өөө © © ы 


— A 
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For example, a nonsteel company with a 
Score of 0.94 said 


We ue the industrial relations activity should 
restes DELE into the individual plants to the 
са degree possible. Operations and employee 
Шай so inter-related that the effective ad- 
and ration should be exercised at the local level 
on ihe ee by the same management. The limit 
eect y degree of decentralization depends on the 
visio of local actions on the other plants and di- 
mine of the company, and the responsibilities 
bale by corporate management governing broad 
cor 7 application and expenditures. In this area 
ee industrial relations staffs function best— 
eed and advising both local and corporate 
agement, 


And another with a score of 1.12 said 


A 


d good rule of thumb: Centralize information— 


®centralize action, 


a oes not mean that the Corporate Industrial 
jo ons Department does not get into the actions 
Ich are normally decentralized. They do. But only 

decan needed. For example, collective. bargaining is 

in, tralized, but with detailed, continuous report- 
ed of local bargaining, the Corporate Dept 

Total he does step in (1) when the trend o ШЕ 

бе bargaining may substantially affect moe! - 

Orga; Ocal unit; or (2) when unorganized uni des 

харо for the first time; ог (3) when тиле. 

to th changes bring new, inexperienced manag 
€ local bargaining table. 

Thi « 

Cords 

tion, 

Spe 

Wa; 


Tule ^" eans centralized re- 
of thumb" also m тагу administra- 


—but decentralized wage and sal ш 

with the Corporate staff stepping уч bee 

Cial problems arise or major revisions of the 

8e-salary program are contemplated. 

oe almost all the comments, the underlying 
eme seems to be, “Centralize policy, се 


centralize practice.” But in working out this 


одап, there seems to be a м 
Concerning what policy embraces, which prac- 
WES may be delegated, and how far. 1 
Clivity centralization across сотан, 
the analysis was also undertaken for ote 
he 3g activities, based on the responsibiity 
Classifications assigned һу the 42 юра 
at completed the scale, to identify M I 
Tequently occurring activities and the relativi 
pree of centralization of each activity, over 
ese 42 companies. i 
or the ааг sample, the а. m 
requently occurring corporate industria наа 
lons functions (as indicated by the oid 
Tatio) were: union contract negotiations, con» 
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TABLE 3 


Activity CENTRALIZATION INDEX AND ACTIVITY 
RATIO, BY ACTIVITIES (For 42 RESPONDING 


COMPANIES) 
22 Bcuyity Activity 
Activity centralization тано. 
index 
Union contract negotiations 2.45 97.7 
Contract interpretation 244 97.7 
Supervisory training 1.76 92.9 
Employee benefit adminis- 2.20 92.9 
tration 
Grievance procedure 1.74 90.5 
administration 
College recruiting 2.34 85.8 
Management development 2.08 85.8 
Induction and orientation 1.51 85.8 
training 
Skills and apprentice train- 1.46 85.8 
ing 
Personnel records 1.95 83.4 
Industrial relations research 2.63 81.0 
Executive health programs 2.35 78.6 
Safety training 1.55 81.0 
Selection testing 1.77. 78.6 
Other safety activities 1.40 76.2 
Occupational hygiene 1.57 73.9 
University management 2.13 71.5) 
programs 
Salaried job evaluation 1.76 71.8 
Employee attitude surveys 2.23 69.1 
Tuition aid programs 2.22 69.1 
Hourly job evaluation 1.40 69.1 
House organs 1.73 66.7 
First aid and medical 2.59 64.3 
programs 
Community relations 1.05 64.3 
Employee communications 2.48 62.0 
Recreation programs 1.09 62.0 
Test validation 1.59 59.6 
Merit rating 1.39 59.6 
Eating facilities 1.02 59.6 
Employee counseling 1.23 57.2 
Plant security 0.95 54.8 
Testifying before govern- 1.31 52.4 
mental bodies 
Speeches 1,29 52.4 
Participation in industry 1.13 52.4 
associations 
Public relations 1.03 47.7 
Credit union 0.86 45.3 
Time and motion study 0.74 31.0 
Lobbying 1.24 12.0 
tract interpretation, supervisory training, 


employee benefits administration, and griev- 
ance procedure administration. Supervisory 
training and grievance procedure administra- 
tion tend to involve advisory responsibilities 
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primarily but the other three involve ad- 
ministrative or review responsibilities, 

At the other end of the scale, the functions 
(among the 38 listed) that occur least fre- 
quently among corporate industrial relations 
staff responsibilities are: lobbying, time and 
motion study, credit union, and public rela- 
tions. Generally, industrial relations respon- 
sibility for public relations is advisory only. 
This reflects the fact that the public relations 
function is part of the industrial relations 
function in only a minority of the companies 
surveyed. Where the two are in one depart- 
ment, however, the corporate staff generally 
exercises administrative responsibility. 

From the point of view of centralization— 
decentralization (as measured by the activity 
centralization index), the five most central- 
ized activities were: industrial relations re- 
search, first aid and medical care, employee 
communications, union contract negotiating, 
and executive health programs. The five least 
centralized activities were: time and motion 
study, credit unions, plant security, eating 
facilities, and community relations, For these 
latter activities, if the corporate industrial 
relations staff had a role at all, it was pri- 
marily advisory and consultative in nature, 


CONCLUSION 


The actual distribution of statistics of the 
small sample of companies surveyed is not 
intended to provide benchmarks, particularly 
for companies that are substantially smaller 


Pum Asu 


or substantially larger than those s 
It is suggested, however, that the me [i 
and measures outlined do offer a way 0 lex 
ducing to common scales some very es 
concepts, and collection of data over ae 
of companies comparable in size and pp 
would provide useful comparisons L5 bet 
pany engaged in evaluating its own 1n 
relations organization. 
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USE OF THE WEIGHTED APPLICATION BLANK IN 


SELECTING UNSKILLED EMPLOYEES' 


RICHARD D. SCOTT ax» RICHARD W. JOHNSON 


University of Massachusetts 


The effectiveness of the weighted application blank (WAB) in differentiating 


between long-term ап 
WAB scores correlated .45 


50). When compared with a multip! 


predicted tenure and actual tenure), 
analysis of the рге 
1 "family responsibility, 
ái in the criterion. Females wh 
fair amount of family responsi 


d short-term unskilled employees was evaluated. The 
with job tenure for Ss in the holdout group (N= 
le-regression equation (r=.31 between 
the WAB technique fared well. Factor 
dictor variables yielded 2 factors, “convenience” and 
» which accounted for most of the explained variance 
o lived close to the plant and workers with a 
ibility (e.g, married, older, several dependents, 


live in own home) were more likely to become long-term employees. 


Although the weighted application blank 
(WAB) has frequently been used to hire office 
and sales personnel, it appears to have been 
Used relatively little in selecting unskilled em- 
Ployees, Dunnette and Maetzold (1955) re- 
Port one study in which the WAB was used 
to select unskilled workers; however, their 
Study was concerned only with seasonal em- 
к dy was to 

The primary purpose of this study was ' 
develop a WAB hich would be successful in 
Selecting permanently employed workers at 
the unskilled level. Two related purposes vere 

4) to compare the effectiveness of the W ne 
With a multiple-regression equation base 


"Don the same data in predicting Bap 
turnover, and (b) to describe by means o 
: y items as- 


factor analysis the personal histor 
Sociated with long-term employment. 


[ METHOD - 
s of al 
Subjects, A survey was made of e are 
i us pamanentiy ошын 3 western Mas- 
i ей by a small canning oT М skilled” jobs 
Sachusetts during the past 4 УГ. 0" and bottling 
consisted of such tasks as cles, е ong-tenure 
Pickles. From this subject (5) pool 75, (o, ог 
5 (6 mo, or more) and 75 short-teDU S pleteness in 
ess) were selected on the basis of со 

Alling in the job application form. 
CES ө leted by Rich- 
1 Based upon a master's thesis comple Shard Wi 
ата D, Scott under the supervision. 0 ley M. Moss 
Johnson, The helpful suggestions of 9* Wise mem- 
"nd J. Alfred Southworth, thesis com 

bers, are gratefully acknowledged. 


Biographical items. The 19 biographical items 
listed on the application form were used as the 
predictor variables. 

Procedure. According to the procedures described 
by England (1961), two weighting groups (a long- 
tenure and a short-tenure group) of 50 Ss each 
were randomly selected from the larger sample of 
employees. Item responses for these Ss were com- 
pared for the purpose of assigning weights to the 
items. Differential weights (0, 1, or 2) were assigned 
as outlined by England. 

The remaining 25 Ss in each group were placed 
into two holdout (cross-validation) groups to check 
the effectiveness of the item weights in discriminat- 
ing between long- and short-term employees. 

Tenure, which was of vital concern to the manage- 
ment, was selected as the criterion of worker effec- 
tiveness. Thousands of dollars in unfilled contracts 
were lost each year as the result of labor shortage 
due to rapid employee turnover. 

The 100 Ss in the two weighting groups were also 
used to compute the multiple-regression equation 
between the application-blank items and the criterion. 
A sequence of multiple-linear-regression equations 
was calculated in a stepwise manner by means of 
the Control Data 3600 computer. The relative suc- 
cess of the two weighting techniques (WAB versus 
multiple regression) in predicting job tenure for 
members of the holdout groups was determined both 
by (a) percentage of correct classification, and (b) 
product-moment correlation coefficient, 

The intercorrelations among the predictor items 
for the 100 members of the two weighting groups 
were factor analyzed by the method of principal 
components. The factor matrix was graphically 
rotated to yield simple structure on the criterion 
variable. Only those factors which produced signifi- 


2 The factor-analysis and multiple-regression pro- 
grams were obtained from the series of biomedical 
computer programs developed at the University of 
California, Los Angeles (Dixon, 1965). 
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TABLE 1 


QUARTILES, MEANS, AND STANDARD DEVIATIONS 
or МАВ Scores FOR LONG- AND SHORT-TERM 
ExPLovrEs (Horpovr Groups) 


Group Qi Мап Оз M SD 


Short term $ 8 
Long term 11 14.5 16 


Note.—N = 25 in each group. 


cant factor loadings (р < 05) on this variable were 
interpreted. 


RESULTS 


Of the 19 items, 12 were assigned differ- 
ential weights through the use of the WAB 
technique. When these weights were applied 
to members of the holdout Broups, 72% cor- 
rect classification of Ss was obtained by using 
a cutting score of 14 (the point of maximum 
differentiation). This percentage of “hits” 
was significantly different from chance (50:50 
base rate) at the .01 level of Probability (CR 
= 3.10). 

Table 1 presents the quartiles, means, 
and standard deviations for members of both 
holdout groups. The difference between the 
means was statistically significant (= 
6.38; р < .01). The product-moment cor. 
relation coefficient between the scored ap- 
plication blanks and months on the job was 
45 (р < 01) for the 50 members in the 
holdout groups. 

The multiple correlation between the 12 
significant items and the criterion was 71. 
Nearly as high a multiple R (R = 69) was 
obtained using just six items, The multiple-re- 


gression equation based upon these six items 
is shown below: 4 


Y= 30 (age) + 8.82 (sex) — .69 (miles 

from plant) 4- 5.29 (type of residence) 

+2.66 (number of children) 4- 1.08 (years 

on last job) — 1.99. 
ev Hb. 

3 Tables reporting the assi 
standard deviations, 
loadings for all varia 
Scott’s (1966) master’s thesis on file j 
versity of Massachusetts library, 

^ The discontinuous variables were coded as fo]. 
lows: sex: 0 — male, 1 = female; {уре оғ residence: 
O—live with parents or » l—live in own 


in room 
home, 


RicHaRD D. Ѕсотт Амр RICHARD W. Jounson 


When the application forms for members d 
the holdout groups were scored by means п 
the multiple-regression equation, the papi 
age of correct classification (based on am 
ting score of either 9 or 10) fell slightly s 
72% to 70%. The size of the correlation is 
tween the weighted scores and the MET 
dropped from .45 to .31. (Neither of : m 
differences was significantly different fro ; 
chance at the .05 level.) Both indexes gcn 
that the WAB was as efficient as, if not ШЫ, 
than, the multiple-regression equation 
assigning weights to the variables. 58 

Because the optimal cutting scores ү” 
established after inspection of the аша, * 
Suggested by England), accuracy of classi “3 
tion was also compared at several pem 
cutting levels, The relative success of the ом 
techniques in predicting tenure status for d 
holdout Ss at the twenty-fifth, fiftieth, т> 
Seventy-fifth percentile points is pe : 
Table 2. While the WAB appears to holaa 
slight edge in accuracy of prediction, te i 
ferences which exist may best be explaine 
terms of chance alone, lear- 

Factor analysis produced two rather-c x. 
Cut factors which loaded high on шешеп as 
variable: (а) “family responsibility "i 
counted for 16% of the variance in the pss 
terion, and (5) "convenience" ARP 
for 3195 of the Variance. Only 496 of t 2 
variance was accounted for by the moe 
factors (k? = 51); 49% of the variance wa 


А е 
unaccounted for by any of the factors in th 
factor analysis, 


Discussion he 
The WAB Proved to be an effective int 
nique in selecting long-term unskilled нр 
үүө, Тһе higher the individual's score on ng 
WAB, the greater the likelihood of his палы 
With the company a reasonable length Пу 
time. While the cutting score of 14 uu 
ifferentiates between the long-term and tice 
short-term employees, the company in eu 3 
Would use as high a cutting score as the ау. 
able labor market permitted. mul- 
Tt is Surprising that weighting by the 1 ef- 
tiple-regression technique was not men ap- 
fective than the WAB. Two explanations a 
pear to be most plausible: (а) the use 0 
fairly large number of predictor varia 


da 
jl 
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TABLE 2 


Comparison or WAB AND MULTIPLE REGRESSION 
IN PREDICTING TENURE STATUS FOR HOLDOUT 
SUBJECTS AT 3 ARBITRARY CUTTING LEVELS 


Accuracy of 
classification 


Cutting-point 
score 


Percentile 
7. Multiple АВ | Multiple 
WAB regression Ы regression 
| 
Twenty-üfth | 7.5 s | 70%| 62% 
Fiftieth 12 u |70 66 
Seventy-fifth | 15.5 16 |66 66 


Note.—None of the differences between the percentages at 
e three cutting levels was significantly greater than chance 
Xbectancy (р 2.05). № = 50. 


(initial n = 19) with a relatively small NV 
N= 100) may have yielded unstable 
Weights, and (0) several of the variables 
€g., age, education, distance lived from 
plant, and years lived in the state) appeared 
to be nonlinearly related to the criterion. 

Future comparisons of the two weighting 
Drocedures may profit by the use of a larger 

and the application of curvilinear multiple- 
Tegression techniques. Until such comparisons 
Сап be made, however, the WAB, which is 
Much easier to develop and apply, stands as 

€ recommended weighting procedure. 

he two factors isolated by means of the 

factor analysis, “convenience” and “family 
responsibility,” appear reasonable. The one, 
Convenience, suggests that unskilled fe- 
males who live fairly close to work are likely 
to stay on the job. The other, family respon- 
sibility, describes the long-term employee as 

er, married, providing for one or more 
pendents, living in his own home, and as 
AVing worked a relatively long period of 
ime on his last job. | 

€ convenience factor agrees well with 

Unnette and Maetzold's (1955) findings that 
‘males make good seasonal, unskilled em- 
Ployees and that, in general, workers who live 
near the plant are more likely to continue on 

* job. The family responsibility factor, how- 


ever, is missing in Dunnette and Maetzold’s 
data. Presumably, the unskilled worker who 
is employed only seasonally is less likely to 
hold large-scale family responsibilities. The 
long-term seasonal worker, described as young 
(under 25) or old (over 55), married, but 
with no children, and possessing 10 yr. or 
more education, suggests a young college 
student or semiretired individual in search of 
summer employment. This same person would 
be unlikely to seek unskilled employment on 
a permanent basis. 


CONCLUSION 


The WAB developed in this study success- 
fully differentiated between long-term and 
short-term employees in the cross-validation 
study. The WAB technique appeared to be as 
effective as, and certainly simpler than, the 
multiple-regression technique in weighting the 
item responses. 

Factor analysis of the data suggested that 
two dimensions, convenience and family 
responsibility, could adequately account for 
most of the variance in the criterion tapped 
by the variety of biographical items. The 
family responsibility factor appeared to differ- 
entiate between the permanently employed 


and the seasonally employed long-term un- 
skilled workers. 
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AN EMPIRICAL INVESTIGATION OF TWO IMPLICA- 
TIONS OF THE TWO-FACTOR THEORY OF 
JOB SATISFACTION 


CHARLES L. HULIN axo PATRICIA А. SMITH ! 


University of Illinois 


2 implications of the 2-factor 


theory of job satisfaction are derived and 


tested empirically using data from 670 office employees, supervisors, and ex- 
ecutives employed by the same company. The results indicate that the predic- 
tions of the 2-factor theory were Provided no support whatsoever, The tradi- 
tional model of job satisfaction, which holds that any variable in the job 


One of the major propositions of the two- 
factor theory of job satisfaction (Herzberg, 
1966; Herzberg, Mausner, & Snyderman, 
1959) which distinguishes it from other, more 
traditional, models of job satisfaction is that 
certain variables in the work situation lead to 
overall job satisfaction but not to dissatisfac- 
tion. Other variables lead to overall job dis- 
satisfaction but not to satisfaction. (These 
two classes of variables have been labeled at 
different times satisfiers and dissatisfiers, 
motivation and hygiene variables, content and 


[ Sic and extrinsic 
variables.) In other Words, satisfaction with 


regard to the dissatisfier, Further, dissatisfac- 
tion with a satisfier 


University, who was th i 
fessor. This paper represents а i i 
r. E Portion of a th 
submitted to the Graduate College of the University 
of Tllinois by the junior author in partig fulfillment 


of the requirements for the Master of Science degree. 


that while the presence of a job characteristic 
will have one effect on a job the absence of the 
same characteristic will not have the opposite 
effect. з 
Recently two articles (Ewen, Smith, Hulin, 
& Locke, 1966; Graen, 1966) have presenten 
data which indicate that, contrary to the pre 
dictions of the two-factor theory, satisfaction 
with a dissatisfier does lead to overall дап 
faction and dissatisfaction with а satisfier 
does lead to overall dissatisfaction. The ed 
sults of these two analyses (which were жу 
on the same data) clearly support the d 
tional theory of job satisfaction without а 
assumption, of course, that all variables аг 
equally potent contributors to job yep 
Unfortunately, both the Ewen et al. and bs 
Graen articles have what could be considere 
а serious shortcoming. They measured a 
job satisfaction by means of the Er 
Motors Faces Scale (Kunin, 1955) роя is 
assumes that job satisfaction-dissatisfactio? | 
а continuum and job dissatisfaction is — 
а low level of job satisfaction. (The бое" 
Motors Faces Scale consists of drawings n 
faces varying from one with a deep ae 
through a “neutral” face to one with a ns 
Smile. The S is requested to check the fa 
Which indicates how he feels about his ay 
most of the time.) Tf, as the two-factor theo pi 
Suggests, satisfaction and dissatisfaction e 
qualitatively different, the use of such а p 
tinuum could raise some doubt about the ped 
clusions and the criticisms of Herzberg " 
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sulting from these analyses. It would seem 
that in order to adequately test the two-factor 
theory it must be assumed that it is correct 
and satisfaction is qualitatively different from 
dissatisfaction, and overall satisfaction and 
dissatisfaction must be measured on different 
Scales. If the Ewen et al. and Graen findings 
are supported after the separate measurement 
9f satisfaction and dissatisfaction, then much 
more confidence could be placed in the 
validity of their conclusions. 

In this paper the authors propose to analyze 
the contributions of different variables to 
Overall satisfaction and dissatisfaction and to 
examine the differences between the presence 
and absence of different variables in their 
effects on workers’ judgments of jobs. 


METHOD 
Subjects 


The Ss for this study were the home-office person- 
pel of a large international corporation with its 
pr office located in Montreal, Quebec. In July 
i % all of the employees were requested to take part 
па Job-satisfaction survey which the company was 
conducting in cooperation with the authors. The 
questionnaires were given to the employees by 
tibartmenta] representatives after the representa- 
ives had met with the senior author and had the 
actionnaire explained to them. The employees were 
h *d to complete them at home or, if they thought 

€Y would have 30 uninterrupted min., to do them 
Work. All employees up to and including the 
cutive vice-president were asked to participate in 
ы study. The questionnaires were then placed in 
со Opes, sealed by the respondents, and returned 
di er to the investigator or sent through the mails 
rectly to the University of Illinois. Anonymity was 
guaranteed to all respondents and they were as- 
ured that their individual responses would not be 

* known to the company. Names were not re- 
шее оп the questionnaires, but for many of the 
= Ployees their job title and department (which 
mae Tequested) would be enough to identify the 
wipondent, Of the approximately 800 employees 
Een Worked in the home offices and were present 
: ring the period of the study, 670 (83%) returned 

Sable questionnaires. Not all Ss completed all the 
questions So the N for any given analysis may not 
equal 670. 


exe 


Variables 


Satisfaction with five job aspects (work done, 

У, promotional о tunities, supervision, апа со- 
pportunities, 

Workers) was assessed by means of the Job De- 

© роп Index (JDD. The JDI is а cumulative- 

Cint adjective checklist which appears to possess 


high convergent and discriminant validity (Quinn & 
Kahn, 1967, p. 456; Vroom, 1964). АП question- 
naires contained the five JDI scales. 

Overall job satisfaction was assessed by one of 
three variations of the General Motors Faces Scale 
(Kunin, 1955). The original scale consisted of five 
faces with varying smiles, a neutral face, and five faces 
with varying frowns. One variation of this scale 
utilized in this study consisted of the neutral face 
as its low end and the five faces exhibiting varying 
degrees of happiness. The workers were asked to 
indicate their feelings of satisfaction with their job 
in general (JIG) on this scale. They were asked 
to check the neutral or unsmiling face if they ex- 
perienced no satisfaction on their job. A second scale 
consisted of the neutral face as the high end and 
the five faces with the varying frowns. On this scale 
the workers were asked to indicate their degree of 
dissatisfaction with their job in general. They 
were asked to check the neutral or unsmiling face 
if they experienced no dissatisfaction on ther job. 
The third scale consisted of three smiling faces, the 
neutral face, and two frowning faces. On this scale 
the workers were asked to indicate their feelings 
of satisfaction or dissatisfaction with their job in 
general. The numerical values assigned to the dis- 
satisfaction scale faces were 1 through 6. For the 
satisfaction scale the values were 6 through 11. For 
the satisfaction-dissatisfaction scale the faces chosen 
were 2, 4, 6, 7, 9, and 11. The satisfaction and the 
dissatisfaction scales overlap at one point, that is, 
the neutral face which was given a value of six. The 
satisfaction-dissatisfaction scale overlapped with both 
the satisfaction and the dissatisfaction scales. Any 
face was given the same numerical value no matter 
which scale it appeared in. There is evidence avail- 
able (Kunin, 1955) that the numerical values as- 
signed to these faces approximate an equal interval 
scale. It should be noted that the satisfaction-dis- 
satisfaction scale used in the present study is iden- 
tical to the scale used in the Ewen et al. and Graen 
studies and thus provides a partial replication of 
their results. One-half of the workers received the 
satisfaction-dissatisfaction scales, one-quarter the 
satisfaction scale, and one-quarter the dissatisfaction 
scale. The scales were randomly distributed within 
departments. 

Two other scales were designed expressly for this 
study to assess the contribution of the presence or 
absence of various job characteristics to the manner 
in which workers responded to different jobs. Six 
different working situations were described in terms 
of six job characteristics (interest and difficulty of 
work done, working conditions, pay received, pro- 
motional opportunities, co-workers, and supervision). 
On one of these two scales, each working situation 
would be described as having five of the character- 
istics about average (eg. the work is about average 
in interest and difficulty, the working conditions are 
about average in comfort and convenience, etc.), 
and one of the characteristics would be described as 
being outstandingly good (eg. your co-workers are 
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A very good job 


A job with many good features 


A good job 


A good job with some bad features 


A job with some good features 


I can't decide whether it's good or bad 


A poor job with some good features 


A job with many bad features 


A job with absolutely no merit 


Fic. 1. Graphic rating scale for obtaining judgments 
of desirability of various Working situations. 


times as being average in the six working situations 
which were presented. The order in which the char- 
d in any description was 


hey 
The Ss were 


A second version of this 
descriptions of the working 
latter version five of the ch 
and one was bad (eg, yo 


Scale consisted of Similar 
situations except in this 
aracteristics were average 
u have almost по chance 


to be promoted). Again the workers were ag 
indicate on the same scale how they woul оу 
about such a job. By reasoning similar to that E i 
this version of the scale should enable us to ‘ould 
mine those job characteristics whose absence Tis 
have an impact on workers’ reactions to е adi 
Approximately one-half of the workers pietas 
version of this scale. The forms were ran 
distributed within departments. 


Predictions 


Based on these 12 variables (five JDI prem 
variables, JIG, and the six job aspects) a кз: the 
of specific hypotheses can be generated whe factor 
traditional model of satisfaction and the ctor 
theory make antithetical predictions. The EOS wit 
theory would predict that satisfaction tional 
work done and satisfaction with pre traction 
opportunities should be related to =н = dis- 
with the job in general but not related ditional 
satisfaction with the job in general. The tra pus 
model of job satisfaction would predict that 1 op- 
faction with work done and with Dromobene ction 
portunities would be related to both хуя the 
and dissatisfaction with the job in general. d only 
other hand, pay satisfaction should be si atte 
to overall dissatisfaction and not to overal The 
faction according to the two-factor 055 ction 
traditional model would predict that pay satis deu 
would be related to both satisfaction and dissa! m 
tion. The other two areas of satisfaction P supere 
by the JDI do not permit clear predictions. vision 
vision is Supposedly a dissatisfier, but super is a 
may contain elements of recognition which has 
Satisfier. Satisfaction with co-workers at times 97, 
appeared to be а dissatisfier (Herzberg, 1966, ВЕ а 
102, 108), but at other times has operated e no 
satisfier (Herzberg, 1966, p. 104). There 
Predictions were made for these two variables mode 
On the two-factor theory. The traditional reu 
Would predict that both of these variables. ction. 
be related to both satisfaction and disse ноз 

The two-factor theory would make no pre faction 
regarding the overall potency of the satis base 
areas being measured in this study. Hoyweve ates 
9n the results of the Ewen et al. and Gies work 
it could be predicted that satisfaction yi more 
done and promotional opportunities would id pay 
highly related to overall satisfaction than wou e jo 
satisfaction, Since these were the only ta ction 
aspects dealt with in the two studies no pre a а 
сап be made regarding the relative potency 
five of the aspects. 3 ter- 

In terms of the impact of the six jub intus e 
istics used to describe the six working SituaBo ау 
Way workers report they would feel about a Job The 
antithetical predictions can again be gene sence 
traditional model would predict that if the кте їп 
of a variable was related to a job being aco i 
good terms (being judged as a good job); cribe 
that variable were absent the job would be a job)- 
in relatively poor terms (being judged as a ba 


ио лл л зж“ ыыы 
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Thus, if the importance or impact of the six job 
characteristics as computed from the form of the 
questionnaire where five characteristics were average 
but one was outstandingly good were plotted against 
the values computed from the form where five 
characteristics Were average and one was outstand- 
з bad, a positive linear function (within the 
noe of the equality of the scaling intervals) should 
ie obtained. The two-factor theory, on the other 
and, would make no such prediction. Since the 
Presence of certain characteristics leads to a desirable 
job but the absence of the same characteristics does 
not lead to the job being considered a bad job one 
Would not expect such a function. The two-factor 
iry would predict that if the work were very in- 
eresting or if there were good opportunities for ad- 
Уапсетепі on jobs, then these jobs would be seen as 
very good, other things being equal. However, if the 
Work were very uninteresting or if there were no 
Opportunities for advancement these jobs would not 
necessarily be judged as being bad jobs, other things 
ting equal. They would only be neutral on the scale. 
d рау, on the other hand, should lead to а job 
Fd judged as being relatively bad, but high pay 
b Ould not necessarily lead to a job being judged as 
cing good. Thus, the two-factor theory would not 
Predict a linear positive function between the im- 
ortanca of the six characteristics as obtained from 
* two forms of the questionnaire. The form of the 
ation would be indeterminant from the assump- 
Оп of the two-factor theory. 


RESULTS 


The results of the correlational analysis for 
е male employees are presented in Table 1. 
Coking only at the three variables for which 
Predictions were made evidence is found 
dearly supporting the predictions of the tradi- 
lonal model of job satisfaction and clearly 
ISconfirming the predictions of the two-factor 
ae of job satisfaction. Satisfaction with 
Work done, pay received, and promotional 
b» dvancement) opportunities and policies is 
"Enificantly related to satisfaction, dissatis- 
Кек and satisfaction-dissatisfaction with 
e job in general (JIG). The lower cor- 
relations between these variables and JIG 
Ìssatisfaction are probably due to the sharply 
reduced variance on this latter scale. Due to 
© * satisfaction levels encountered in this 
?mpany the JIG dissatisfaction scale was 
essentially a 3-point scale (Ss checked mainly 
1е three top faces with only two Ss checking 
“асе No, 3), Nonetheless the correlations 
tween work and promotion satisfaction 


Supposedly satisfiers) and JIG dissatisfaction 
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TABLE 1 


CORRELATIONS BETWEEN SATISFACTION WITH 
DIFFERENT ASPECTS OF THE JOB 
AND OVERALL Јов SATIS- 
FACTION FOR MALE 


EMPLOYEES 
JIG 
JDI  j|satifaction-| JIG JIG 
satisfaction | dissatis- | satisfaction deae 
area faction (N = 95) ОП 
(У = 170) кезш 
Work BI .68** Ast 
Pay 32** aon .24* 
Promotion 42** .40** Sart 
Supervision 32** so .25* 
Co-workers x ad^" .48** A3 
*p < .05. 
wep < .01. 


were significant as was the correlation between 
pay satisfaction (essentially a dissatisfier) and 
JIG satisfaction. These three highly signifi- 
cant correlations are directly opposed to the 
predictions of the two-factor model. 

The correlations between supervision and 
co-worker satisfaction and the JIG scales are 
presented in the interest of hypothesis form- 
ulation since no predictions were made for 
these two variables. 

The correlations between work, pay, and 
promotion satisfaction and JIG satisfaction- 
dissatisfaction lend but slight support to the 


TABLE 2 


CORRELATIONS BETWEEN SATISFACTION WITH 
DIFFERENT ASPECTS OF THE JOB AND 
SATISFACTION WITH JOB IN 
GENERAL FOR FEMALE 


EMPLOYEES 
JIG 
JDI satisfaction- JIG "m 
satisfaction | dissatis- | satisfaction Pied 
area faction (N = 52) z5 
(N = 154) (Qv = 68) 
Work .60** AS** EM 
Pav 30** 12 48 
Promotion AL** 46** 14 
Supervision 45** :31% —.03 
Co-workers 3б” 20 —.08 
жр < .05 
py < .01 
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culty of Work 


D D 
бо-Чогкега Supervision 


WorAng Conditions 


log Importance Vnluo of Characteristic who! 


Isportance Value of Ch 


Present ——__» 


of job characteristics 
portance values of job char- 
male sample. 


Fic. 2. Importance values 
when present versus im 
acteristics when absent, 


generality of the Previous results of Ewen 
et al. and Graen regarding the relative po- 
tency of the intrinsic as opposed to the ex- 


trinsic variables. Both work and Promotion 
satisfaction are more high] 
JIG satisfaction-di: 


The results of the c 
Sed on data from the 


However, the pattern of correlations pura 
was obtained from the female sample ars 
little support to the two-factor theory. am 
work satisfaction is more highly correa is 
with JIG satisfaction-dissatisfaction Ec 
pay satisfaction. The promotion satisfac 4 
JIG satisfaction-dissatisfaction correlatio ds 
not significantly greater than the correspo 
ing value for pay satisfaction. -— 

Neither of these two sets of data Sud rts 
the predictions of the two-factor mery dec 
data from the male sample do support t. ч io 
dictions of the traditional model a 
male data partially support these pre zy fron 

The results of the importance analysis Ше 
the two forms of the questionnaire pae 
male sample are given in Figure 2. import- 
Figure 2 and Figure 3 the log of the “teristic 
ance or impact value of the job charac jotted 
if absent from the working situation = Р ШЕ 
against the importance or impact va prt 
job characteristic if present in the n ien 
Situation. Using this log transforma of the 
the scale values of the importance ts for 
Characteristic if absent merely Е the 
unequal scale intevals at the two P utin 
Scale shown in Figure 1. Values of site le of 
istics when absent are based on a sar еп} 
180. Values of characteristics when Laren 
are based on a sample of 191. The r тений 
Ship between the two sets of values insforma- 
2 is obviously linear (under the es aod. 
tion described above) and the ^ that for 
Thus, these results clearly indicate variable 
male workers, if the presence of a deed as 
results in a job being described or Tale re- 
good, the absence of that same Me other 
sults in the job being described as es з оше, 
things being equal. This finding, о b satis- 
Supports the traditional model of jo -factor 
faction and argues against the e wit 
theory. Only the values for pp uiri the 
Co-workers are seriously out of line wi 
Prediction of the traditional model. idi 

The results of the importance ana re 
the female sample are given in 2s resen 
Importance values of characteristics i eem сё 
are based on a sample of 157. Impo base 
values of characteristics if absent ы tiona 
9n a sample of 140. As in the correla 


s of 


y 


—— | —n—À 


Two-Factor THEORY or JoB SATISFACTION 


analysis these data from the female Ss are less 
clear-cut than the male data. While a re- 
gression line through these data points would 
be positive and linear, there is more scatter 
about the line than in the male data. It is 
interesting to note that interest and difficulty 
of the work, pay level, and promotional op- 
Portunities have nearly the same effects if 
Present or absent as they did in the male 
Sample. For the other three variables, the 
results are more random. Again, these results 
do not support the two-factor theory and tend 
to confirm the predictions of the traditional 
model. Also, satisfaction with co-workers does 
Not appear to fit well with the remainder of 
the variables. 

The data in Figures 2 and 3 also support 
the findings of Ewen et al. and Graen in that 
they clearly indicate differential saliency 
among the various factors which contribute to 
Job satisfaction. Further, in both the male 
and female samples the intrinsic aspects of 
the job (interest and difficulty of the work) 
are responded to by the workers as being most 
Important, This also supports the conclusions 
of Ewen et al., in that a division of the factors 
Into intrinsic and extrinsic is more meaning- 


Ш than the labels “satisfiers” and “dissatis- 
fiers,» 


DISCUSSION 


It is clear that the present results provide 
10 support for the predictions which one 
Would make on the basis of the two-factor 

Cory of job satisfaction. The so-called satis- 

ers acted as both satisfiers and dissatisfiers, 
and the dissatisfier acted as satisfier as well 
аз а dissatisfier, The analysis of the import- 
ance of various job characteristics on the way 
People reacted to different job situations was 
€ same whether the characteristic was pres- 

t or absent, No evidence was found which 
Would support the argument that satisfaction 
2nd dissatisfaction are qualitatively different. 

the differences in the variances between the 
] Satisfaction and the JIG dissatisfaction 
Scales are taken into account, these scales do 

ОЁ give qualitatively different results than 

ao the JIG satisfaction-dissatisfaction scale 
П terms of their patterns of correlations with 
ег variables. Tt would seem that the tradi- 
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. 
Interest ond Difficulty of Work 


Promotions 


log Insortonco Volue of Characteriatie 1f Atacnt —> 


Inportence Value of Characteristic if Present —————> 


Fic. 3. Importance values of job characteristics 
when present versus importance values of job char- 
acteristics when absent, female sample. 


tional model of job satisfaction has been 
strongly supported at the expense of the two- 
factor theory. 

With these results, along with the other 
failures to replicate Herzberg’s original re- 
sults whenever different research methods are . 
used (see Dunnette, Campbell, & Наке], 
1967; Ewen, 1964; Ewen et al, 1966; for a 
discussion of these nonconfirmatory results 
and the methods used), it would be reasonable 
to point out again that Herzberg’s (1959, 
1966) results appear to be method bound and 
the conclusions appear to pivot on method 
variance rather than true content or scale 
variance. A construct which can be generated 
or supported by only one operation would 
seem to have little relevance to the behavior 
of workers. Little more can be said. The au- 
thors join with Dunnette, Campbell, and 
Hakel in hoping that the two-factor theory 
can be laid to rest with a minimum of fanfare. 
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This study provides a further test 
rate plan were paid with an equit 
(104) for doing an interviewing jo 
the underpaid Ss produced mor 


i vi of lower quality. The е 
the interviews were ps E andy pad s dg фуу 


ch S was given the California Personality In- 
lationships among the CPI scale scores and Ss' job 
ormance were considered. The results of the study 
eory but suggested that further elaboration 
nequity-reduction methods will be chosen 


as more interesting than did 
important and challenging. Ea 
ventory (CPI), and the ге 
attitudes and job perf 
generally supported equity th 1 
is needed if it is to predict what i 
by a given individual. 


The focus of the present study is upon the 
uman tendency to seek cognitive consistency. 
Pecifically, it attempts to further test Adams 
(19633) theory of inequity. Ada 
Сап be thought of as a special case of 

estinger's (1957) cognitive dissonance the- 
Огу. Although Adams’ theory was designed to 

a general theory of social inequity using 
the exchange model (Blau, 1964; Homans, 
1961), so far the focus has been upon ех- 
Perimentally testing it with respect to the 
“ects of wage inequity. К 

Adams (1965) defines inequi 
he perceives 

^t aput pu the 
Others inputs are 
d Other are in a di- 
e in an exchange 
Person com- 


Adams’ theory 


ty as follows: 


Thequity exists for Person whe! 


The theory further stipulates that the greater 


© inequity of the input-outcome, balance, 

е greater will be the resulting „disson 16 
and the greater will be the mo ш 
Corrective acts, Inputs in the job situatio 
cum ke to thank C. Argyris, 
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of Adams’ theory of equity. Ss on a piece- 
table wage (25¢) or an unfairly low wage 
b. As predicted, the results showed that 
e interviews than the equitably paid Ss, but 


underpaid Ss tended to see the job 


a person may include his education, skill, and 
how hard he works. Outcomes include such 
things as pay, fringe benefits, status, and the 
intrinsic interest of the job. It must be 
remembered that what determines the equity 
of a particular input-outcome balance is the 
individual’s perception of what he is giving 
and receiving, and this cognition may or may 
not correspond to the perception held by 
others. 

Adams and his associates in testing equity 
theory have focused upon how inequity due 
to overpayment affects the quality and 
quantity of work in a job situation. The re- 
sults of these studies have consistently tended 
to support equity theory; when subjects (Ss) 
have been made to feel overpaid they appear 
to have adjusted their work quality and 
quantity in such a way that an equitable 
balance was created between their inputs and 
their outcomes, For example, hourly paid Ss 
who were given the impression by the experi- 
menter (E) that they were unqualified for 
the job (low inputs) worked harder (higher 
quantity) than did those Ss who were told 
that they were qualified for the job (Adams, 
1963b; Adams & Rosenbaum, 1962). This 
finding supports equity theory since working 
harder is one way of increasing inputs in 
order to create а favorable balance that was 
not present initially. 
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In other studies (Adams, 1963b; Andrews, 
1965) Ss have been made to feel either 
equitably paid or overpaid on a piece-rate 
basis and a quite different result appeared. 
The Ss who felt overpaid produced less than 
those who felt equitably paid, but the work 
Was of higher quality, This finding is also 
congruent with the theory since, by restrict- 
ing their productivity and increasing their 
Work quality, the overpaid Ss were behaving 
in such a way as to lower their financial out- 
Comes, thereby bringing them more in line 
With their inputs. Other studies (Adams & 
Jacobsen, 1964; Arrowood, 1961) have at- 
tempted to establish that the same results 


appear even where job Security does not 
concern Ss, 


Thus, the evid 
view that, when 


expended. Andrews (1965) found t 
paid Ss when compared with equitably paid 
Ss produced Somewhat more, but that there 
Was not a significant work-quality difference, 

this may have been due to the 


equity theory, 
It should be noted that in his 
has always induced feelings of 


them feel either qualified or 
the job. The 


changing the actual pay rates of 5s. With the 
Adams approach the feelings of ine 


1 quity are 
created by E before S begins the job, and the 
question is, how will he behave in order to 


reduce these feelings? When the amount of 
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piece-rate pay is altered as was done es 
drews and as is also done in the present 5 iy 
S does not know that he is being - 
paid until he actually begins to риш 
job. At this point the key issue concerns vili 
the S will define the job in order to deal j^ 
the inequity that has been built into pvi 
situation in which he finds himself. One : ro- 
ous advantage of this approach is that E in 
vides a better simulation of the situa ка 
Which most employees who are on nei it 
plans actually find themselves. In additio ss 
eliminates àny questions concerning the 2 in 
sibility that the results can be ac aoa де 
terms of job insecurity, which once Y the 
workers are told they are unqualified acta 
job. On the negative side, manipulating @ lat- 
Рау in one sense is not so clean as wage a 
ing qualifications because E has s Ot 
Over when and how S comes to realize oint 
he is in an inequitable situation. At this val Е 
it would appear to be logical to pre id 
lecting data using both approaches to in Yo 
ing feelings of inequity, since both can P 
Vide meaningful data relevant to the then dd 
dams has emphasized that an andes 
Part of equity theory is that there me ity 
Ways of reducing dissonance due to pei 
than simply varying productivity and Ti 
of job performance, Inequity can be кш 
һу altering or perceptually distorting ap Es 
and outcomes other than pay and pro ТЯ 
tivity, by leaving the field, or by changi is 
another comparison object. Except for has 
study by Andrews (1965), no attention ion 
been paid to methods of dissonance reducti 
that are less obvious than simply changini 
productivity and work quality on the pcd 
side and Рау On the outcome side. Ad 
found that underpaid Ss on a piece rate iob 
show a significant tendency to see the ps 
as simpler than did the equitably paid ade 
Presumably, seeing the job as simple ™ 5% 
the low рау more tolerable by жацы. ) 
Job inputs on a dimension (job boe ing n 
relevant for the determination of par Iter- 
cause of the importance of considering а е 
native dissonance-reduction methods, it es 
decided in the present study to include meas- 
ures of several kinds of attitudes and ре, 
tions of job inputs and outcomes that A: r 
serve as dissonance-reduction mechanisms {0 
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the underpaid Ss. The expectation was that 
by seeing the job as relatively simple, un- 
challenging, and unimportant, Ss that are 
underpaid can lower their perceptions of their 
inputs in a way that will reduce the inequity 
they feel from being underpaid. In effect, they 
can reason that unimportant jobs do not 
deserve high pay. In addition, it was ex- 
Pected that by seeing the job as interesting, 
underpaid Ss can increase their outcomes, 
ereby reducing the dissonance produced by 
low-pay outcomes. It may appear that it is 
Unreasonable to predict that an S will say а 
task is at the same time simple and unchal- 
enging, but interesting. However, the predic- 
tion is only that the underpaid Ss will see 
the task as relatively less challenging and 
Complex, but more interesting, than will the 
equitably paid Ss. The theory does not neces- 
Sarily predict that the underpaid Ss in an 
absolute sense will say the job is unchalleng- 
ing and simple, but interesting. | 
Completely unexplored in the area of equity 
cory is the question of what factors in- 
fluence the choice of methods used to reduce 
inequity, Equity theory makes few predic- 
tions here and none of the experimental work 
las dealt with this topic. At least one dimen- 
Sion that seems to be relevant is the im- 
Portance to the S of the pay pe M 
arning, Presumably an 5 in a piece- 
underpayment x adem who badly needs 
Money at the time of the study will be more 
likely to use the dissonance-reduction method 
ОЇ raising his productivity and thereby his 
Pay, than will be the S to whom money 
15 relatively unimportant. 
In addition to the impor 
May be certain personality 
тйцепсе the kind of dissonanc 
ethod an individual will use 10 77. 
Payment situation. Thus, it was decided to 
Include in the present study а personality 
test in order to help understand the io 
ОЁ dissonance-reduction mechanisms made y 
55 in the underpayment situation. Particula Y 
relevant for this purpose seem to be the sca 
rom the California Personality Inventory 
(CPI) that are designed to measure p 
ascendancy, and self-assurance, and е 
Signed to measure maturity and responsibility. 


he self-assurance scales upon which low 


tance of рау, there 
dimensions that 
e-reduction 
the under- 


scorers are characterized as being self-defen- 
sive and given to feelings of guilt and self- 
blame appear to be relevant because as Weick 
(1965) has pointed out, low rewards can be 
quite threatening to a person’s self-confidence. 
Because of this it seems that high-self-assur- 
ance persons might react differently to an 
underpayment situation than low-self-assur- 
ance persons. The responsibility scales appear 
to be relevant because it was expected that 
they might be related to the degree to which 
Ss are willing to sacrifice quality for quantity. 


METHOD 
Subjects 


Forty Yale University undergraduate students 
served as Ss for the study. They were hired either 
through the student placement service or through 
an advertisement placed in the student post office. 
All Ss prior to applying for the experiment were 
told that they were being hired to work on an inter- 
viewing project and that they were being hired 
for only 2 hr. of work. They were also informed 
that their salary would be based upon a piece-rate 
system. The Ss were randomly divided into an 
equitable payment group (n= 20) and an under- 
payment group (#=20). A comparison of these 
two groups on such factors as age, year in school, 
and expected wages showed no significant differences. 


Procedure 


A pretest was run to determine the size of the 
piece rate to be paid the equitable and the under- 
paid groups. The pretest Ss were paid on an hourly 
rate ($1.65) and were instructed to do interviews 
for 2 hr. using the same interview forms that were 
used for the experimental Ss; the pretest Ss averaged 
15 interviews in the 2-hr. period. On the basis of 
this finding and the fact that the standard student 
placement office minimum rate was $1.65/hr for the 
students hired, it was felt that a rate of $.10/inter- 
view would be perceived as underpayment and a 
rate of $.25/interview would be perceived as equi- 
table payment. These perceptions of equity and 
inequity were expected to result when Ss compared 
their input-outcome ratio with that received by other 
students doing part-time work at the University. 
Confirmation of this expectation was obtained in 
a questionnaire completed by each S upon com- 
pletion of the job. The Ss were asked to answer an 
item on a 7-point scale which had as one end of 
the scale underpaid and at the other end, equitably 
paid. The underpaid Ss described their jobs as 
relatively underpaid (mean score 3.2), while the 
equitably paid Ss described their jobs as being equit- 
ably paid (mean score 4.1). The fact that differences 
appeared even after the underpaid Ss had an op- 
portunity to reduce their feelings of inequity argues 
strongly that feelings of inequity were successfully 
induced in the underpayment group. 
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ТАВГЕ 1 


Propuctiviry, Work QUALITY, AND ATTITUDE 
SCORES ОР THE EQUITABLY AND THE 
UNDERPAD SUBJECTS 


Underpaid Equitably 


(n = 20) paid t 
(п = 20) 
TUE | 


| | 
Productivity (No. 


interviews) 29.6 20.0 4.42+++ 
Quality (No. words per 

interview) 42.9 60.6 2,91*** 
Qualifications (11ow to 

7 high) 54 58 | 1.02 
Boring-Interesting 

(1-7) 6.1 54 3.06*** 
Unimportant- 

Important (1—7) 3.6 44 1.86* 
Simple-Complex (1-7) 34 41 1.52 
Unchallenging- 

Challenging (1-7) 3.6 4.5 2.07** 

* 
PRA 
жер < 0, 


When the experimental Ss 
located away from the psycholo; 


Upon completion of the job application, each S 
was given the following job description: 

You will be paid for 
time, two hours o; 


must realize, this might bias 
Е 1 our i 
technique. Since the intervi ч we “ша 


interviewers as Dossible i; 


n o 
bias that any one intervie 


The four questions that composed the intery; 
were open-ended ones Concerned with student Su 
life at Yale. The questions dealt With topics Süch as 
drinking at Yale and visiting hours f 


P ОТ women in 
students’ rooms. Each question was designed so that 
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the interviewer would have considerable latitude is 
how completely he recorded each нарай 
answer. The interviewers’ guide gave several Т» 
guides to effective interviewing (e.g, ask deed 
in order shown on form and interview only regn ord 
students). The instructions also told Ss to ai to 
cach interviewee’s comments in sufficient det was 
enable someone else to interpret correctly what ШУ 
said.” Because of the stress on recording an st 
interpretable record of what was said, it ie ter- 
that the number of words recorded by the Ме 
viewer from each interview would serve as a reas 
able measure of the quality of the eus 
content analysis of а random sample of intervi ear 
Confirmed this expectation. More words did ete 
to be clearly associated with conveying more iew. 
formation about what took place in the d 
ang (1963b) and Andrews (1965) have also Ч 
this measure of qualit А 

When Ss ной - 2 hr. of interviewing, ed 
Were asked to complete а postwork questione 
because “this is a new job and we are conside тз.” 
how it might be changed for future intem 

© PoStwork questionnaire asked them to ln io 
on two scales running from 1 (not at all) r the 
(very much) how well qualified they were fo from 
job, and how much they needed the money them 
the job. In addition, the questionnaire asked items 
to answer five 7-point semantic differential rtant- 
Concerning the job (boring-interesting, Loos wed 
important, simple-complex, unchallenging-cballe 
underpaid-overpaid) , jonnaire, 

Upon completion of the postwork question. 
cach S was informed about the nature of the po 
He was then asked not to discuss its oam е0 
anyone, and Es Stressed the point that the valu i 
the study was dependent upon the extent to tion. 
future Ss felt they were in an employment situa ay- 
e 5 Was then told that he would receive в ive 
ment of $5.00 or what he had earned, whic ош 
Was greater. The $ Was then asked if he H was 
assist E by completing a personality test tha tions 
designed to help us understand peoples’ кеш 
to job situations,” All Ss then completed the 
fornia Personality Inventory (Gough, 1957). 


RzsurTS 


LÀ 

It was expected from equity theory that ps 
underpaid Ss would tend to reduce the РУ 
Sonance associated with underpayment 
Producing more than the equitably paid = 
did and by Producing work that was ors 
quality than that produced by the equitab 
paid Broup. Producing more in a piece 


рта 
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TABLE 2 


PEARSON PRODUCT-MOMENT CORRELATIONS BETWEEN THE CALIFORNIA PERSONALITY 
INVENTORY SCALES AND THE SCORES ох Јов PERFORMANCE 
AND Јов ATTITUDES 


Poise, Ascendancy, and Self-Assurance 


ity for ЕЕ Social Selí- Ba 
Dominance i ° Sociability Presence Acceptance Well-Being 
maw [оой | 2 |e | ME NE. 
dd F .02 25 à E 3 
Boring-Interesting —07 —10 —19 02 0% о 
ob-input attitudes —48 —.09 03 
Socialization, Maturity, and Responsibility 
i Good | 
Responsi- | Socialization Self-Control | Tolerance торак Communality 
bility 
CENE NEC NS 
ivi - —.32 —.54** 19 
Quduetivity 24 12 o д Sm E 
uality .38* 18 16 o 3 E 
op nE-Interesting —.28 —.35 10 "b ies Ee 
"Input attitudes* 18 —.10 . 


5 Average correlation соећсіе 
sy? < :05, one-tailed test. 
b <.01, one-tailed test. 


Ss to do more interviews than the equitably 
Paid Ss, but to record significantly fewer 
Vords for each interview completed. 
. Table 1 also shows that there are some 
Significant attitude differences between the 
"quitably paid and the underpaid groups. 
Ccording to equity theory, adjustments in 
Attitudes toward job inputs and job outcomes 
Offer a potential method of dissonance reduc- 
tion, Specifically, it was expected that сЕ 
Sonance might be reduced by the underpai 
Ss feeling that they received significant 
intrinsic task-interest outcomes from the task. 
Chis expectation is supported by the de 
Since the underpaid Ss did tend to see E 
Job as significantly more interesting than dl 
Ше equitably paid Ss. А second expectation 
Was that the underpaid Ss might reduce ш 
lissonance by perceiving that they had = ^ 
tively low inputs to the job. This ире ss 
Жаз also generally supported by the m 
еу saw their own qualifications as ess 
than did those Ss who were in equitably paid 
&roups, although this difference was not sig- 
nificant. They also saw the task as demand- 
ing lower inputs on their part. In commen 
to the equitably paid group, they saw the 


nts for importance, complexity, 


and challenge scales. 


task as relatively unimportant, simple, and 
unchallenging. In summary, it appears that 
underpaid Ss tended to reduce their dissonance 
by increasing their productivity, by seeing 
the job as interesting, and by seeing the job 
as being relatively unimportant and unchal- 
lenging. 

The data relevant to the question of what 
personality factors contribute to the degree 
to which different dissonance-reduction mech- 
anisms are used by the underpaid Ss can be 
found in Table 2. The scales from the CPI 
that were designed to measure poise, ascend- 
ancy, and self-assurance show a consistent 
tendency to be related to productivity (three 
of the correlations are statistically significant 
and all six are in the same direction). The 
Ss high on these scales are lower producers 
than Ss who score low on these scales. No 
consistent relationship appears between the 
poise, ascendancy, and self-assurance scales 
and any of the attitude measures. The group 
of scales on the CPI that were designed to 
measure socialization, maturity, and respon- 
sibility show a consistent tendency to be 
positively related to work quality (three of 
the six correlations are statistically significant 
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and all six are in the same direction). How- 
ever, they fail to show a consistent relation- 
Ship to any of the other measures. Not shown 
in Table 2 is the correlation between the de- 
gree to which Ss said they needed the money 
and their productivity; as expected, it proved 
to be positive and statistically. significant 
(r = 46, p< 05). In summary, it appears 
that the poise and self-assurance scales, along 
with the importance of pay to the S, pre. 
dicted productivity well, while the mat 


and responsibility scales 
quality. 


urity 
predicted work 


Discussion 


When faced 
-rate Situation, 
designed to in- 


decreases their 
in th 


developed toward the job, 
Apparently, 
realized how low + 


А Sure productiyit 
give some idea of what ue 


after Ss realized the kind of Payment sit, 
in which they found themselves. 

It is interesting to note that with a 
Production rate of 29.6 interviews, the y 


uation 


Mean 
nder- 
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js 
paid Ss earned an average of тыз M. 
is slightly below the expected wages га 
ment office jobs at Yale and, as in itably 
these Ss did feel underpaid. The «ог 
paid Ss, on the other hand, earned pe 
Which exceeded the standard placemen were 
rate, and yet they indicated that pe y 
equitably paid. That this group felt “г how- 
paid at a rate of $2.50 is not surprising, that 
ever, since Andrews (1965) has por to 
the threshold for overpayment appe? tively 
quite high, so that employees are relati 
insensitive to overcompensation. hourly 
(1963b), for example, has used pm col- 
Tate of $3.50 as an equitable rate ks. Just 
ебе students doing interviewing pat with 
the opposite Condition appears to ех appear 
110 егсотрепѕа (оп, since employees п that 
to be very Sensitive to any cond a ier 
might involve underpayment. Also 0 that aP” 
is the obviously larger productivity nd the 
Peared in both the equitably paid 4 retest 
underpaid Broups in comparison to г їп 
S who averaged only 15 interview vee! 
2-hr. period, The obvious difference e on ap 
€ groups was that the pretest Ss ky? were 
hourly Tate, while the experimental tes can 
9n a piece situa" 
Droduce hi 
tions, a fi d 
easily han, 
e underpaid 
was more interesti 


: im 
Outcomes on the intrinsic task-interest e the 


underpaid Ss also tended to md un- 
atively unimportant, simple, 2 these 
Challenging. Seeing the job as low 5 inputs 
d appear to reduce 55 nd ш“ 
Simple, unimportant, апе pan 
К demands less of an ortan 
065 a complex, challenging, and imp 
one, e 
Weick (1964) has found a task-enbant". 
facut effect that appears to be similar tO et 
tendency in the present study for the ЧП est^ 
Paid Ss to describe the task as more eli 
ing than did the equitably paid Ss. low- 
found that Ss who find themselves in а ore 
reward situation tend to see the job as з 
interesting than do Ss who find themse "or 
in an equitable-reward situation. The та] s 
difference between the two studies is that th 
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Weick study did not offer Ss a chance to gain 
greater financial outcomes by increasing their 
productivity as was possible in the present 
study, The fact that a task-enhancement ef- 
fect appeared in the present study where 
alternative means of dissonance reduction 
were easily available would seem to argue 
that it is a powerful and rather frequently 
used dissonance-reduction mechanism, espe 
cially if the task is rich in content, which the 
Interviewing task is. 

It is interesting to note that the underpaid 
Ss recorded slightly more words during their 
2 hr. of interviewing than did the equitably 
Daid Ss, This would seem to indicate that the 
Underpaid Ss worked as hard if not harder 
than did the equitably paid Ss. Weick (1964) 
also found that underrewarded Ss worked as 

ard as equitably rewarded ones and in fact 
he found a tendency for them to work harder. 
his finding does not appear to be easily 
Predictable from equity theory. The impor- 
tant difference between the two payment 
Stoups in the present study was in how many 
Words the Ss recorded for each interviewee. 
learly the underpaid Ss were willing to sac- 
Tice quality by getting few words per inter- 
view in order to increase their monetary out- 


Comes, 
Thus, when considered together, the results 


of the comparison between the reactions Ps 
the job by the equitably paid Ss and the 
Underpaid Ss offer support for equity theory 
In two significant ways- First, they indicate 
that the predictions of equity theory about 
the effects of payment on productivity which 
Previously had been primarily tested in over- 
Payment situations also appear to hold in e 
Underpayment situation. Second, the results 
emonstrate, as predicted by equity Шешу) 
that in addition to using Changes 1 gru 


miy and work quality to realice we ped 
s al MA d perceptua 4 
so use attitudinal and P t-outcome 


nisms to arrive at an equitable inpu 


alance, 

The personality measures and the поша 
9f the importance of the money earned to 
= were included in order to understand em 
importance these factors might have in de 
termining the degree tO which Ss used the 


i б isms. 
different dissonance-reduction mechanis! 


Perhaps the most significant result here is the 


finding that the importance of the money to 
the S is significantly associated with S’s try- 
ing to increase his productivity in order to 
reduce dissonance. Not surprisingly, Ss who 
need money more are more likely to increase 
their productivity. This finding is quite pre- 
dictable from Vroom’s (1964) theory of mo- 
tivation and from other path-goal theories, 
but it is a good example of the kind of pre- 
diction, about which dissonance-reduction 
mechanism will be chosen by an individual, 
that equity theory frequently fails to make. 

The data from the personality test provide 
some clues as to the types of individuals who 
are likely to raise their productivity in order 
to be able to reduce their dissonance. Interest- 
ingly, those Ss who are low on the measures of 
poise, ascendancy, and self-assurance seem to 
be characterized by high productivity. Weick 
(1965) has suggested that one effect of low 
reward is that it raises a person’s concern 
about his worthiness, competence, and ade- 
quacy. Clearly this would be expected to 
happen much more easily in Ss who have low 
self-assurance already. For these Ss it may be 
that raising productivity presents the only 
concrete way of reducing these feelings of 
guilt and self-doubt, and showing the E and 
themselves that they really are worthwhile. 
"Task enhancement and input reduction might 
not be effective for this personality type. To 
the extent that a large number of Ss in the 
underpaid group were motivated by a self- 
confidence threat rather than by simple dis- 
sonance, this may offer an alternative inter- 
pretation to the impact of underpayment on 
productivity. However, it does not appear to 
explain the attitude differences as well as does 
the equity-theory explanation. 

The maturity and responsibility scales tend 
to correlate significantly with work quality. 
Apparently for people with a high sense of 
responsibility and maturity, sacrificing quality 
for quantity was an untenable solution to the 
dissonance situation. It might even be argued 
that for these Ss the dissonance was not great 
because it failed to threaten their perceptions 
of self-worth. Independent of this, however, 
it probably is generally true that Ss with a 
high sense of responsibility will be Jess likely 
to choose a dissonance-reduction means that 
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EFFECTS OF MONETARY REWARDS AND PUNISHMENTS 
ON VIGILANCE PERFORMANCE * 


RUSSELL L. SMITH,? LUIGI Е. LUCACCINI, лхо MURRAY Н. EPSTEIN 


University of California, Los Angeles 


In a complex visual vigilance task lasting 1 hr., Ss in 5 e 
р 5 detections and punished either for missed targets 


control group performed the task without pos- 
nt. 3 levels of monetary incentive were used 
f the study indicated that (a) some combina- 
facilitated detection performance while others 
for missed targets performed better than Ss 


were rewarded for correct 
or for false alarms. Ss in a 
sibility of reward or punishme 
as rewards. The major results o 
tions of reward and punishment 
did not, and (b) Ss punished 


punished for false alarms. Implications 


discussed. 


The results of most vigilance research can 


е separated into two broad categories, de- 
Pending on the type of display used. With 
Mackworth 


Simple displays, such as the 
Clock Test (Mackworth, 1950), the percent- 
age of correct detections declines rapidly from 
3n initially high level to a relatively low and 
ereafter constant level. This decline is the 
Well-known vigilance decrement. With more 
Complex displays, such as multiple-dial moni- 
toring (Jerison & Wallis, 1957); performance 
tends to be low and constant throughout the 
task, and decrements are se 
Although much of vigilanc 
5 n concerned. with se m 
“task ers may be i 
the low aye ie m 0 found with both 
nds of displays, some investigators feel that 
Motivation is the key to understanding vigi- 
ance behavior. Mackworth (1961), for ex- 
ample, has pointed out that the performance 


Idom found. 

ce research has 
ng what physi- 
responsible for 


of “dedicated” tstrips that of the 
ed" Ss far outstrip: Н 
tYpical S, Moreover, Elliott (1960) has ar 


Sued that the vigilance decrement does к 
Sven occur in military monitoring tasks, "e 
Kibler (1965) has doubted the relevance o 
aboratory vigilance results in general. е a 
one is willing to accept the questionab e "^ 
Sumption that laboratory Ss are as concerne! 
a ee 
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for vigilance research and theory are 


in vigilance tasks as, for example, radar op- 
erators, the proposition must be accepted that 
“typical” vigilance results may be, in large 
part, artifactual. Rejection of that assump- 
tion logically suggests a more rigorous evalua- 
tion of the effects of motivation. Existing 
theories of vigilance, save one (Smith, 1966), 
have not treated the variable of motivation 
to any significant degree. In view of some 
rather dramatic results obtained by early in- 
vestigations (Fraser, 1953; Mackworth, 1950) 
which employed certain modes of motivation, 
the failure to give sufficient consideration to 
that variable is somewhat surprising. 

The present study attempts to investigate 
the effects of motivation on vigilance perform- 
ance by the use of monetary incentives. Three 
prior studies (Bergum & Lehr, 1964; Pollack 
& Knaff, 1958; Sipowicz, Ware, & Baker, 
1962) have employed monetary incentives 
with different results. Pollack and Knaff 
(1958) reported a slight (and apparently 
nonsignificant) improvement in detection per- 
formance when Ss were offered “ап extra hour 
of pay" for “either 100% detection in seven 
of eight 10-minute periods or the greatest 
improvement in scores over the previous 
tests." Since Ss were already guaranteed pay- 
ment for 50 hr. of service and since the re- 
ward was to some extent competitive, it is 
questionable whether the offer was an effec- 
tive inducement. 

Sipowicz et al. (1962) found monetary in- 
centives to be of considerable benefit, while 
Bergum and Lehr (1964) did not. In the 
latter study the performance of rewarded Ss 


411 


412 


was superior to that of unrewarded Controls 
only for the first of three consecutive 20-min. 
Periods. Both studies employed similar dis- 
plays, small amounts of money, and similar 


reward, false- 
Ss punished f 


visual display 
п, hat used in 
‘ucaccini, Groth, & 
Scribed їп 


noise 
squares that differed from 
in the number of sides con argets 


Sixty 
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minutes were required to present the entire tape, 
which moved at a speed of 0.5 in./sec. s 
For purposes of target presentation the tape ks 
divided into six consecutive 10-min. display pa 
Within each unit, four targets occurred at random y 
selected temporal intervals. Two targets each T 
peared alone against the noise background; аве 
other two appeared with a false target in the zs 
Posite half of the display. Two more false p 
appeared at random temporal intervals РЕ 2 
display unit. Thus, over the entire ара 
targets and 24 false targets appeared. Twelve E 
appeared alone against the noise background 8 
appeared as target-false-target pairs. basi- 
Experimental conditions. The experiment ve with 
cally a 6x2x2x 3 repeated-measures dei pes 
six incentive conditions, two sexes, two target ^ 
and three time intervals, Independent groups ondi- 
and 24 Ss served in each incentive and sex С re- 
tion, respectively, The remaining variables were 
peated measures take ch 5. i - 
Incentives, Eight Ss served in each incentive com 
dition. erve 
Control (Condition C): Ss were told to € 
the display continually and report targets aS 
as they were detected, ноп LE): 
Low Incentive, Errors Punished (Condition, ion 
Ss were instructed as in Condition C. In ай 
they were told that each correct detection wou s 
rewarded with a Payment of 10¢ at the end derat 
experiment, Every erroneous report (false i the 
Would be punished by a deduction of 10¢ ere 
к= earned. No punishment was given for 
Low Incentive, Misses Punished (Condition LM 


Ss received simi, ; ition 
milar іп, i to Conditi ile 
cept that 10 structions hi 


f Was deducted for missed targets W 
ere not penalized. ition 
Incentive, pee Punished (Cone 
" to Condition LE except that rewa 
consisted of 20¢. ition 
;- LCOntive, Misses Punished (Conai А 
а сыы to Condition LM except that те 
and penalties Consisted of 20¢. "m E): 
High Incentive, Errors Od (Condition Ee 
Ss were instructed as in Condition С. In ad n“ 
they were informed that they would be Ed s 
certain fixed amount of money” for each COE ea se 
tection upon completion of the experiment. -half 
alarms would be penalized by subtracting he total 
Of the reward for a correct detection from the nal- 
amount earned. Missed targets would not be Erect 
ized. It was possible to earn “up to $10 for pe ce.” 
Performance and $4 or $5 for average performan ig 
(Condition HE was included to induce a very rly 
level of motivation. When it became apparent ea bt 
in the study that Condition HE Ss indicated um 
regarding the genuineness of the reward, a Бан 
condition, HM, was dropped for reasons of cc 
omy.) Ü 
Sex. Each incentive Eroup Was composed of Tis 
males and four females to assess the effects of S€ 
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of S on performance. This variable was included to 
Provide another test of an earlier finding that there 
Were no differences in performance between males 
and females (Smith et al, 1966). 

Target Lype. This variable reflected the attempt to 
vary the level of task difficulty by presenting targets 
alone or with false targets against the noise back- 
ground. Targets presented alone have been shown to 
be detected more easily (Smith et al., 1966). 
aoe interval. This variable corresponded to the 
ase of the task into three successive 20-min. pe- 

S in order to assess sequential effects. 
c Procedures. The Ss served individually in the task. 
?eneral instructions were read to each S at the be- 
саша of the experiment explaining the nature of 
tice task and the response procedures. À 2-min. prac- 
ез Session followed in which knowledge of results 
tis given verbally by E after each target or false 
io us appeared. Further instructions were then given 
zt S in the various incentive conditions, questions 

Out procedure were answered, and the task began. 

9 interruptions were permitted during the hour. 
disi nication with E, who remained behind the 
i ау, was prohibited, and S was asked to remove 
Es Watch, At the end of the hour, payment of the 

m earned was given to Ss of incentive groups. A 
ep tionnaire was then administered on „which Ss 

mated the duration of the task in minutes, Te- 
Ported the amount of money they had expected to 
arn, and rated the following items: (a) interest in 
«16 detection task, on a 5-point scale ranging from 
кы interesting" to "very boring," and (b) belief 
hà Start of the experiment in the genuineness of the 
acentive offer, on a s-point scale ranging from 

finitely thought I would be paid” to "definitely 

Ought I wouldn't be paid." 

erformance measures. Two separ 
au were recorded for each S. 
of f er of correct target detections 
Ds alse alarms (incorrect reports t 
re Deared), These two measures were 

COrdings of target presentations and 

HR presses) made with a four- 
nds event recorder. 


ate performance 
These were the 
and the number 
hat a target had 
derived from 
Ss’ responses 
channel Ger- 


RESULTS 


The number of correct detections was 
Summed for each S and tested for significant 
differences between conditions by analysis of 
Variance, The results showed that two main 
effects reached significance: Incentive Condi- 
tion—F (5/36) = 2.67, p < .05—and Target 

Ype—F (1/36) = 9.09, p < .01. The only 
first-order interaction to reach significance 
Was Target Type x Time Period—F (2/72) 
= 9.93, р < .001. One higher-order interac- 
tion was significant, Incentive Condition x 
Sex x Time Period x Target Type—F (10/ 
72) = 222, р < 05. 
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TABLE 1 


MEAN PERCENTAGE DETECTIONS BY TARGET 
TYPE AND Tre PERIOD 


Target Successive 20-min. intervals 
presentation 
mode 1 2 3 
А1опе 68.2 60.5 64.0 
With false target 45.8 56.2 65.5 


Figure 1 presents mean detection perform- 
ance by successive 20-min. periods under each 
of the six incentive conditions. А curve rep- 
resenting performance in a previous study 
(Smith et al., 1966) is included in the figure 
{ог comparison and will be discussed below. 
A Newman-Keuls test (Winer, 1962) of the 
overall means for the six incentive conditions 
revealed that detection performance was sig- 
nificantly higher (p < .01) in Conditions LM 
and MM than in the other four conditions, 
with Condition MM superior to Condition 
LM (р < .01). Differences between the re- 
maining four conditions did not reach sig- 
nificance. 

Table 1 presents mean detection perform- 
ance as a function of target type and time pe- 
riod. A Newman-Keuls test of the means for 
this interaction revealed that, although over- 
all performance was better for targets pre- 
sented alone, the difference in performance 
between the two modes of target presentation 
was significant (p < .01) only for the initial 
20-min. period of the task. Performance did 
not differ significantly among the three in- 
tervals for targets presented alone nor be- 
tween the last two intervals for targets pre- 
sented with a false target. 

Analysis of variance failed to reveal signifi- 
cant differences between incentive conditions 
in the number of false alarms committed. 

Analysis of responses to the postexperi- 
mental questionnaire revealed significant dif- 
ferences for the question regarding S’s belief 
in the genuineness of the incentive offer (x? = 
13.33, df =1, p < .001). Six of the eight Ss 
in Condition HE stated that when they 
started the task they did not expect to re- 
ceive the promised payment upon completing 
the task. In contrast, 28 of the 32 Ss in Con- 
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PERCENTAGE DETECTIONS 
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2 
TIME IN 20 MINUT 
Fic. 1, Signal detection 


ditions LE, LM, ME, and MM felt that they 
would “probably” or “definitely” be paid. 
e Ss in Condition С Were not asked this 


ing 
than the Contro] group (x? = 5 76 4} = 1 
Ф < .02). The Ss in Condition С Tated the 
task as boring, while all ot 


her groups rated it 
at about the midpoint (“so-so”) or the in. 
terest scale. 
Analysis of variance of the mean earnings 
estimates for the five rewarded incentive 
groups revealed significant differe 


nCes be. 
tween groups—F (4/35) = 3.30, ? < 05. 
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E INTERVALS 


MEDIUM- MISS 
BUZZER - ALERTED 


LOW -MISS 


HIGH — ERROR 
MEDIUM — ERROR 
LOW - ERROR 
CONTROL 


3 


MEAN 


Р Р ime in- 
Performance under various Incentive Conditions as a function of time 
e completely dashed curve (buzzer.4] 


F al. 
erted) represents data taken from Smith et 


an 
A Newman-Keuls test showed that the ; adi 
estimate for Condition HE ($3.94) he other 
nificantly (p< 05) higher than for the other 
four STOUDs. Differences between the Mean 
four 8toups did not reach ыш, an 
estimates for Conditions LE, LM, oo a 
Were $1.28, $1.43, $1.26, and $2.06, 

spectively, þe- 

here were no significant differenc S ett 
tween the six incentive conditions deresti- 
mates of task duration. All groups un tas 
mated the duration of the vigilance 

= 44.9 min.), 


Discusston 


; ort 
The results of this study provide supp is 
for the hypothesis that when motivatio 
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increased by monetary incentives, perform- 
ance on a complex vigilance task can be sig- 
nificantly enhanced. Although only two of the 
five rewarded incentive groups (Conditions 
LM and MM) performed significantly better 
than Controls, there is evidence that the mo- 
livational technique employed was not effec- 
tive in the other three rewarded groups. In 
the case of Condition HE, it is clear from 
answers to the postexperimental questionnaire 
that, although earnings estimates were high- 
est for this group, Ss in this group were 
nearly unanimous in their belief that the 
Money earned during the task would not be 
Téceived upon completion. In Conditions LE 
and ME, although Ss apparently accepted the 
Incentive offer as genuine, the method of pun- 
Ishment (for false alarms) may have seemed 
SO severe as to reduce the chance of earning 
а large amount of money. Answers to the 
Postexperimental questionnaire tend to sup- 
Port this interpretation; Ss in these two 
Sroups reported lower earning estimates than 
5 in Conditions LM and MM. 
The significance of the performanc 
ancement found in Condition MM on 
Complex vigilance task can be apprecia 
Y comparison with the performance of an 
alerted group from a prior study that em- 
Ployed similar Ss and the same vigilance task 
Smith et aL, 1966). In that study, uncer- 
tainty of signal presentation was eliminated 
for the alerted Ss by sounding a buzzer 1 sec. 
е оте the signal appeared. Figure 1 shows 
that the performances of the two groups were 
Nearly identical. 

The hypothesis that, at each level of re- 
Ward, Ss punished only for missed targets 
Would detect more targets than those pun- 
‘shed only for false alarms was clearly sup- 
Ported. In fact, the effects of method of pun- 
Ishment were so strong as to overshadow the 
effects of level of incentive. For example, Ss 
Paid 10¢ per detection and punished for 
Missed targets (Condition LM) outperformed 
Ss paid 20¢ per detection but punished for 
false alarms (Condition ME). | 

'The failure to find differences in detection 
Derformance between male and female Ss is 
Consistent with the results of an earlier study 
(Smith et al., 1966) employing the same vigi- 


e en- 
this 
ted 


lance display. This finding is in contrast to 
that of Whittenburg, Ross, and Andrews 
(1956) who found the performance of females 
to be superior to that of males on the second 
half of a 2-hr. task. 

The significant improvement in detection 
performance that occurred for the more diffi- 
cult target type (1.е., those presented with a 
false target) is in agreement with the results 
of the earlier study (Smith et al., 1966) using 
these two target types. In both studies the 
most likely explanation is that some learning 
occurred during the initial part of the task. 

Task-interest ratings indicated that the 
vigilance task may have been less boring for 
Ss in the five rewarded groups than for Con- 
trols. Nevertheless, all groups indicated some 
degree of boredom. This finding suggests that 
the essentially monotonous nature of the vigi- 
lance task was not altered by incentives even 
though performance was facilitated. 

Finally, what explanation can be offered 
for the fact that rewards were beneficial in 
the present study (Conditions LM and MM) 
and in that of Sipowicz et al. (1962), but of 
only temporary benefit for Bergum and Lehr 
(1964)? In all three investigations rewards 
were earned in proportion to the number of 
targets detected, earnings were decreased for 
missed targets, and the maximum possible 
earnings were about the same. In the Sipo- 
wicz et al. (1962) study Ss were informed 
of the maximum possible reward ($3.00), but 
in the current study, with the exception of 
Condition HE, and in that of Bergum and 
Lehr (1964) Ss were informed only of the 
reward per signal (10 or 204) and of the cost 
of errors. In the latter two studies, Ss had to 
have some idea of the signal rate in order to 
estimate whether or not the task was “worth- 
while? in terms of probable earnings. This 
knowledge could be gained only after serving 
in the study for some period of time. By the 
end of the initial 20-min. period of vigilance, 
Ss in Bergum and Lehr's (1964) study may 
have realized that the signal rate was low 
(12/hr) and decided the potential earnings 
did not warrant continued “extra effort." 
This would explain why the performance of 
their rewarded group subsequently dropped 
to the level of the Controls. In the present 
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study, with а signal rate of 24/hr, Ss in Con- 
ditions LM and MM apparently decided that 


"extra effort? would be adequately compen- 
sated. 


The results of the 
ally consistent with the 
from Smith's (1966) motivational theory of 


(Pollack & 
& Lehr, 1963; Fraser, 1953), 


of results—true, false 
1961; 


Mackworth, 
lpowicz et al., 1962; 
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SEARCHING FOR NEWSPAPER HEADLINES PRINTED 
IN CAPITALS OR LOWER-CASE LETTERS a 


E. C. POULTON 


Applied Psychology Resea: 


Altogether 264 adults searched for hea 
various members of the Times group О 
and a 2 X 2 factorial design was used to с 
ted in Titling or Extended Titlir 


Headlines prin 
4.5, 4.0, 3.0, an 0 
longer to locate than when pri 
approximately matched the heights 0 
printed in smaller letters above or 
tention from the main headlines ( 
were printed in lower-case letters, 
attract attention when they wer 


lower-case letters of the same por 


d 2.5 mm. according to 
the 


Most people who take a daily newspaper 
0 not read it systematically like a fiction 
Paperback, starting at the top of the first 
Page and ending at the bottom of the last 
Page. Instead they glance at the headlines, 
and read only the paragraphs of news below 
© headlines which look interesting. Even 
me Paragraphs of news are not always read 
sy Stematically when the reader is in a hurry. 
€ may simply run his eyes down а paragraph 
Oking for news of a particular sort. Common 
Observations of this kind on readers of news- 
Papers suggest that the criteria which have 
fen used in the past to evaluate experi- 
Mentally the printing and layout of news- 
Papers may not have been the most ap- 

Propriate, 
hen investigating the р 
Paper teadis prete and Tinker's ( 1946) 
research students presented one headline at а 
ime for a limited period. Their measure was 
© number of words read in the time avail- 
е. At a normal reading distance, reliably 


More words were read on the average when 
ite SENA 


lo 


rinting of news- 


F А í 
1 This research was carried out at the request 0 


a William Haley, then editor 
he ] to the Edit 
" Pages of newspaper, to Walter Г 
а imes Educational ырла 
> га а! A 
aa ee Publishing Company, for 
Specifying the typographical arrangements used. 
; M. E, Altham kindly advised on the shes 
Financial support from the British Medical Research 
Suncil is also gratefully acknowledged. 


typographical 


nted in bold lower- 


р< 053 


rch Unit, Cambridge, England 


dlines which were printed 3 times in 
{ typefaces. There were 2 newssheets, 
ompare pairs of alternative printings. 
ng capitals with heights of about 
their importance, took reliably (p € 01) 
case letters whose x-heights 
{ the capital letters. Subsidiary headlines 


below the main headlines distracted at- 


). When most of the main headlines 


subsidiary headlines were more likely to 


e printed in capitals than when printed in 
nt size (p < 05). 


using two-line single-column headlines printed 
in 24-point Cheltenham Extra Condensed 
lower-case letters than when using headlines 
printed all in capitals (upper-case letters) of 
the same type face and point size. Sixty-point 
Memphis Bold capitals were at a reliable ad- 
vantage over the corresponding lower-case 
letters in multicolumn headlines only at a 
reading distance of 17 ft., where the greater 
average height of the capital letters made 
them more visible. 

Unfortunately this rate-of-reading method 
measures only the readability of individual 
headlines. It is not a measure of the attention- 
getting value of a headline located on a sheet 
of newspaper, which is what newspaper 
editors are (or should be) interested in. At- 
tention getting is related to the discrimin- 
ability of the headline from the other head- 
lines on the page, from the advertisements, 
the pictures, and the columns of news. It is 
measured more validly by presenting the 
headline in its setting in a newssheet, and by 
determining how long the average reader takes 
to find it. This is the basis of the method 
used in the series of experiments described 
here. 

There is at present no acceptable way of 
equating upper-case and lower-case letters. 
Point size cannot be used, because it specifies 
only the height of the block upon which the 
letter is cast for printing. It does not specify 
the width of the block, which determines the 
number of letters printed in a line of fixed 
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length. Upper-case letters аге normally wider 
than lower-case letters of the same point size, 
and require a line about 35% longer (Tinker, 
1963, p. 60). Perhaps less well known to 
applied psychologists, point size does not 
specify exactly the height of the face; the 
relationship may vary with the typeface, For 
example, the capitals of the top headlines of 
Figure 1а and b have practically identical 
heights, yet the point sizes are 14 and 18, 
respectively. Similarly lower-case letters look 
large for their point size if the x-height (the 
height of the rounded parts of the letters) 
is large in proportion to the heights of the 
ascenders and descenders (see Poulton, 1965 х 

If lines of upper-case letters are printed too 
close together, the Shapes of the tops and 
bottoms of the letters are masked by the 
adjacent letters above and below. The same 
can happen to lines of lower-case letters if 
they are designed with the xcheight taking up 
a disproportionate amount of the point size. 
The masking between lines of capitals can be 
prevented either by holding the height of the 
face constant while increasing the point size, 
or by leading between the lines. Similarly the 
masking between lines of lower-case letters 
сап be prevented either by holding the 
X-height constant while increasing the heights 
of the ascenders and descenders, or again by 
leading. When the x-height of lower-case 
letters is made to match the overall height of 
capitals, names printed in lower-case letters 
with capitals only for first letters are visible 
at rather greater distances than names printed 
all in capitals (Forbes, Moscowitz, & Morgan, 
1950), When names arranged one below the 


(Moore & Christie, 1963, p. 116) 
To the author’ 


5 knowledge no tests have 
been carried out to see if printed upper- and 
lower-case words are equally readable or dis- 
criminable at normal reading distances w 
equated in this way. However this was not 
aim of the present experiments, The aim 
was to compare an existing style of upper-case 
headlines which had hardly been changed 
since it was first introduced in 1932, with new 


hen 
the 
here 
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designs of upper- and lower-case ӨШ 
Usually the overall heights of the Бает Hs 
medium-sized upper-case letters matche ims 
X-heights of the corresponding beret 
letters, as illustrated in Figure 1. The i ters 
spacing between the lines of upper-case - be- 
was only about half the vertical y ae et 
tween the rounded parts of the loger a 
letters. The words set in large and a 5% 
upper-case letters were usually abou -саѕе 
longer than the corresponding lower 
words. 


METHOD 
Materials 


mns 
The newspaper was laid out in Se ЕН ко 
containing lines of print 2.2 in. long. Де Опе 0 
pases were 16.3 in. wide and 22.0 in. ta “occupied 
the pages carried an advertisement which columns: 
the full length of the three left-hand ns is il 
The layout of the remaining four colum half of 
lustrated in Figure 2. The complete peut 
the other page was taken up by an nove ie lay- 
Which extended across all seven columns. trated i? 
Out of the top half of the page is illus 
Figure 3. " es had 
All the headlines in the two original po id 3a. 
been printed in capitals, as in Figures 2a with all 
he two pages were reprinted twice, once capitals 
the headlines Set in lower-case s pii e an 
being used only for the first letters of head y 
for proper names, as in Figures 2c and 3c. 


in capi- 
Second reprinting half the headlines were - eii à 
tals and half in lower case, as in Figures mbers 


I the headlines were printed in various me 
of the Times group of typefaces. er- 

In the origina] pages, sic of the eight hie Ve 
сазе headlines haq letters about 4.0 mm. ouble- 
double-column headline of Figure 2a and the jght 0 
column headlines in the middle and on the iting 
Figure 3a were set in 14-point Extende leading: 
Monotype Series Number 339 with 6-point headline 
which is illustrated actual size by the top column 
of the pair in Figure 1a. The two single- m 
headlines at the top or Figure 2a and the one set in 
left of the weather map in Figure 3a ve 29 
18-point Titling Monotype Series bet m 
With 3-point leading, which is illustrate ire 
size by the top of the pair in Figure 1b. The ЧЁ 
Column headline toward the bottom of di Figure 
and the double-column headline on the left 0 letters 
За were set in 16-point 339 which Am eadline 
about 4.5 mm, tall The double-column adlines 
had 9.point leading. Six of the large peer 
Were paired with Subsidiary headlines. Four “5 tall 
deck" subsidiaries with letters about 3.0 In ade 
Were located immediately below the main 
lines. The double-column Subsidiary of Figure 
and the right-hand double-column subsidiary ‘with 
Figure 3a were printed in 12-point 339 in 
3-point leading, which is illustrated actual size 
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ZAMBIA ASKS AFRICAN STATES 


a 


FOR ECONOMIC HELP 


O.A.U. CONFERENCE EXPECTED TO SET 
UP SPECIAL FUND 


ADDIS ABABA, MARCH 2 


AUSTRIAN PRESS 
FREEDOM 
CLASH 


b 


COURT ORDERS TO 
EDITOR 


FROM OUR OWN CORRESPONDENT 
VIENNA. MARCH 2 


With only two days to go to the Aus- 


e 


set up 


| the British members of the board of trustees 


NEW TANK FOR EAST 
GERMAN ARMY 


FROM OUR CORRESPONDENT 
BERLIN, Marcy 2 
The east German Army has been 
receiving a new tank, the T55, since the 
beginning of the year to replace the T54. 
General Hoffmann, the Defence Minister, 


FIRST TRIDENT FOR 


PAKISTAN 


Group Capt. John Cunningham, chief 
test pilot of the British Aircraft Corpora- 
tion, piloted the first three-jet Trident air- 
liner of Pakistan International Airways 


ZAMBIA SEEKS ECONOMIC HELP 


African conference expected to 


a fund 


1 the British members of the board of trustees 


ADDIS ABABA, MARCH 2 


Zambia seeks economic help 


f African conference expected to 


set up 


ADDIS ABABA, MARCH 2 


New tank for east 
German army 


м OUR CORRESPONDENT 
BERLIN, MARCH 2 


g 


Fic. 1. Full-size ex 
Sheets with upper-case 


FRO 


headlines. е illustrates the 
se headlines. Two-thir 


a fund 


| the British members of the board of trustees 


First Trident for 


Pakistan 


Group Capt. John Cunningham, chi 

test pilot of the British men re lee 
tion, piloted the first three-jet Trident air- 
liner of Pakistan International Airways 


amples of the headlines used. (a, b, c, and d are illustrations from the news- 


larger paired headlines from the newssheets with 
ds of the smaller headlines were set in lower case 


mixed upper- and lower-case | 
as in g, the remaining third in upper case 


as in d. f, g, and h are illustrations from 


as in c. All the small headlines were set in upper case 
the newssheets with lower-case headlines.) 
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ШЕ КЕДЕИ 
нш 
b Я 


1 


шш d р 


TENER 


SEES EE 
€ 
German taste tuning to antie fareitare 
E Enemy 


€— À 


EXE 


Le 
| 


ИШ 


b. Mixed 


ent which occupied the 


OM MAD» та __ 


ds y 
Шш а} 
Hi 


jsp fg «ng 
Bio ru da 
H i M iip | ES 


|; 


"T 


Н 
ИП iH 


TO Ez 


Б 
ШШ 


l headlines in upper case, 


pages. (A pictorial advertisem: 


umns is not shown, a. AN 
5. c. AM headlines in lower case.) 


mns of one of the 


Fic. 2. The news colu 
full length of the three left-hand col 
upper- and lower-case headlines 


SLBANDRIO EFF 


AGAIN DEFIED 
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STUDENTS iS JAKARTA HANG TMI SHAI GIES 


IGY 


TROOPS PASSIVE AS BAN 15 


м 
u 


ARMNG TO 


tty 


үш 


| 


Students in Jakarta hang 
Subandrio effigy | 


dehet 


DE 
WARMNGTO | 


[E 
S=|~ BRITISH SURGICAL UNITS FOR 


SAUDI ARABIAN HOSPITALS 


THE WEST 


won 


team oo nomads ia desert 


Shah gives а 
warning to 
w 


Fic, 3. The new 


which occupie 
headlines in ирр 


d the com к 
er сазе. b. Mixed upper- and lower-case headlines. c. АП 


s columns 
plete 


headlines in lower case.) 


CENT LATTE FOR SAU ARAMA 


Operations by British medical 


ND Lower CASE 


WU, 


JAMAICA BOYCOTT THREATENED 
FOR ROYAL VISIT 


rminos RUN оси оч аяооєша шал. 
— р 


of the other page. (A pictorial advertisement 


bottom half of the page 


is not shown. a. All 
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Figure 1a. The two single-column subsidiaries of 
Figure 2a were printed in 14-point 329 with 1.5-point 
leading, as in Figure 1b. The large double-column 
headline on the left of Figure 3a was paired with a 
second-deck subsidiary beneath it in 14-point 339 
with 6-point leading. The large treble-column head- 
line toward the bottom of Figure 2a was paired with 
a “strap-line” subsidiary printed above it in 12-point 
italic capitals about 2.5 mm. tall of Times Roman 
Monotype Series No. 327. The medium-sized un- 
paired headlines restricted to a single column had 
letters about 3.0 mm. tall. They were set in 12-point 
339 with 3-point leading as illustrated actual size 
in Figure 1c. The small unpaired headlines restricted 
to a single column had letters about 2.5 mm. tall. 
They were set in 10-point 339 with 3-point leading, 
as in Figure 1d. 

In the reprinted pages, seven of the eight large 
lower-case headlines were set in letters with an 
x-height of about 4.0 mm., using 24-point Times 
Bold Monotype Series No. 334. The three large 
headlines at or toward the top of Figure 2c and 
the double-column headlines in the center and on 
the right of Figure 3c had 6-point leading, as il- 
lustrated actual size by the bottom headline of 
Figure 1f. The single-column headline to the left 
of the weather map in Figure 3c had 9-point lead- 
ing. The eighth large headline on the left of Figure 
3c had an x-height of about 5.0 mm. It was printed 
in 30-point 334 with 6-point leading. Five of the 
large headlines were paired with subsidiary head- 
lines. The double-column and treble-column headlines 
of Figure 2c and the double-column headlines in the 
center and on the right of Figure 3c had strap lines 
printed above them in letters with an x-height of 
about 1.5 mm., using 12-point Times Semi-bold 
Monotype Series No. 421. Three of the strap lines 
were in italics, as in Figure 1f. The fourth on the 
right of Figure 3c was printed in roman letters. The 
large double-column headline on the left of Figure 3c 
had a second-deck subsidiary beneath it with an 
x-height of about 3.0 mm., set in 18-point 334. The 
medium-sized unpaired headlines restricted to a 
single column were also set in 18-point 334, half 
with 4.5-point leading, half with 3-point leading as 
in Figure 1g. The small unpaired headlines restricted 
to a single column had an x-height of about 2.0 mm. 
They were set in 12-point 334 with 3-point leading, 
as in Figure th. 

Seven out of the eight large headlines from the two 
newssheets with mixed upper- and lower-case head- 
lines were identical with the corresponding head- 
lines in the lower-case headline newssheets, The 
eighth, to the left of the weather map in Figure 3b 
was set in 14-point 339 capitals with 6-point leading 
like the top headline in Figure 1a. The five sub- 
sidiary headlines corresponded to the five in the 
newssheets with lower-case headlines, The four strap 
lines were printed in capital letters about 2.5 mm, 
high, using 12-point 421. As before, three of the 
strap lines were in italics, as in Figure 1e, The 
fourth, on the right of Figure 3b, was printed in 
roman letters. The fifth headline pair, on the left of 
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Figure 3b, was identical with the pair in the ac 
case-headline newssheet. Of the medium sS ud: 
paired headlines restricted to a single ipo isst 
thirds were identical with headlines in the aining 
case-headline newssheets (Figure 1g). The jo m 
third were identical with headlines in the all un- 
case-headline newssheets (Figure 1с). mma ed were 
paired headlines restricted to a single ЕЕ ure 10): 
all identical with the upper-case headlines (Fig! ages 19 
No attempt was made in the reprinted The cost 
standardize style of type or point size at d to be 
of what the typographic designer considered n jn- 
good printing practice for newspapers, WHE) he 
cluded avoiding monotony. In a few ca it was 
wording of the headline was changed аре the 
reprinted in lower case, to cast it in a form W S risas 
designer considered to be more suitable for pres The 
tion in lower case (cf. Figures 1a and. s were 
number of columns across which the Headline the 
printed and the positions of the ages are E: 
newssheets were never altered. The print under- 
location of the subsidiary headlines were ic the 
standardized (cf. Figures 2a and c) that se head- 
main comparison of upper-case with lower-ca es were 
lines in Experiment 1, the subsidiary Бей news- 
deleted by gluing over them blank pieces 0 
paper. А 
The stenciled question sheets contain 
headlines, with a blank line below cach 
where the first word of the first paragraph 
Printed under the headline had to be inserte 
order of the headlines in the list was such 
reader had to jump from side to side he nest 
Sheet in going from one question to the 
The large headlines at the top of the newsshee lower 
listed first, followed by the smaller headlines 1 
down the newssheet. The order was identica ews- 
the three printed versions of each of the two head- 
sheets, but since the wording of some of ше inted: 
lines was slightly altered when they were ren ate ] 
Six separate question sheets had to be ConR UE 
so that the wording on a question alert i cor- 
corresponded exactly with the wording of th 
responding printed headline. А he full 
One set of six question sheets contained t he 
headlines, main and subsidiary if present. yhich 
double headlines were typed in the order in V 
they were Printed, with the subsidiary Jine 
Coming first when it was printed as a strap sond 
but coming second when it was printed as а 5 stion 
deck. There was no indication on the ауе 
Sheets as to which headline was main and on 
was subsidiary. The two headlines were YP elow 
separate lines, with a blank line for the answer heets 
the lower headline. Another set of six question 2 {һе 
contained only the main headlines, omitting was 
Subsidiary. Each of the 12 question sheets | etti 
stenciled twice, once typed all in upper-case piv 
Lexikon 80 elite letters, and once typed with 
headlines in the corresponding lower case (сар! 5) 
only for first letters of headlines апа proper name, 
and underlined, making altogether 24 еге! 
stenciled question sheets. 


list. of 
ed ^ headline 
of news 
d. The 
at the 
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TABLE 1 
MEAN NUMBER oF HEADLINES Founp 1х 40 Sec. IN EACH CONDITION 
m н ч Headlines found in 40 
N Headlines present on cue һер 
Experi- З 
ment Mixed Percentage " 
number | All | upper | АШ | difference 
Women | Men | Question sheet | Newssheet upper | and | lower 
3 case | lower | case 
case 
1 63 9 Main | Main 65 |, qa 9 PEA 
2 Main Main — T. 9 <05 
zd 9 Main Main + Subsidiary 6.8 . г 
3 12 | 28 Main Main + Subsidiary | 6.6 72 9 < 05 
Е в | 12 Main Main + Subsidiary | 66 | 66 |, 0 ds 
3 16 8 Main Main + Subsidiary _ 6.7 6.5 3 bro 
б 32 S | Main + Subsidiary | Main + Subsidiary 65 | 54 17 < 001 
D 27 5 | Main + Subsidiary Main + Subsidiary 53 4.6 12 2705 


Experimental Design 


, The seven experiments are li; 1 
та experiment compared à single pau 
itions on a separate group of volunteers; 


Performed in more than one experiment. 


factorial design was always used for tw 


* headlines and 


Wolunteers in each of the four subgroups 
Cels typed in upper-case letters, 
Ad question sheets typed in Jower-case 
Underlined, The number of volunteers 
increased either until a reliable differenc 
a analysis of variance, ОГ un 
ai difference was so small 
Olunteers would be required in 97 e 


reliability, 


Procedure 


The experiment was conducte! 
м volunteers seated at tables. Т 
[s on the tables ranged 

Ach volunteer had two sheets of 
face down on the table and а file 

е stenciled question sheet 
Question sheet and two small prac sd 
Newspaper, Usually the practice 5 
leadlines which were samples from 
Чоп as the headlines of the first 0 
Dewssheets, But in comparing 
Ower-case headlines with ч 
Practice pieces with headlines printed i 
Were not available. 


ad all lower-case 


Piece had mixed upper- and lower e 
Practice pieces were used to teac рп after 
and immediate knowledge of results W 
each step. Incorrect answers were 
the error was explained to the indivi 

The volunteers were told to sear 


the two newssheets. 


{гот about 40 to 


s and 


all lower-case 


Instead the first pra 
headlines ; the secon 


yas gl 


sted in Table ty 
т of con- 
nobod: 


о versions 
Half the 
had question 
the other half 
letters and 
tested was 
е was found 
til it was clea 


1] that a large num 
der to 0 


4 оп groups of up to 
he level of jllumina- 


newspaper 
containing both 


{хей upper- 
ш headlines, 


n both styles 


corrected; 


ch the newssheet 


{ог headlines in the order in which they were listed 
on the question sheet. They had to write the first 
word of news printed under the headline in the 
blank line provided on the question sheet. Volunteers 
who had evidently searched the question sheet 
{ог headlines in the order in which they located 
them on the newssheet were discarded, since the aim 
of the experiment was to compare the speed of 
searching for headlines on the newssheets, not on 
the question sheets. 

Before each part of the experiment proper the 
volunteer took a stenciled question sheet from the 
appropriate compartment of the file, and placed it 
ready for writing on, on his right if he was right- 
handed. When everyone was ready all the volunteers 
turned over their sheets of newspaper (which were 
on the left if they were right-handed) and started 
answering the questions. Forty seconds only were 
allowed for answering the 12 or 14 questions on the 
question sheet. Only one person ever answered all 
the questions in that time. The experiment and 
practices together took about a half hour. 


Experimental Subjects 


The 264 volunteers were members of a panel 
maintained at the Applied Psychology Research Unit 
at Cambridge. Their ages ranged from 21 to 66. 
The sex distribution of the different groups is shown 
in Table 1. About half wore reading glasses for 
the experiment, and a further 9 said that they 
would have done so had they remembered to bring 
them. They were paid approximately $1.05 per hour 
(ie, 7 shillings, 6 pence) for their services plus 
traveling expenses. 


RESULTS 


The results are given in Table 1. The first 
experiment used only the main headlines; the 
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Subsidiary headlines were deleted from the 
newssheets and were not included on the 
Stenciled question sheets. The top row of the 
table shows that the main headlines printed in 
lower case were located reliably (p< .01) 
faster than the same headlines printed in 
capitals. The differences in favor of the lower- 
case headlines averaged 9%. This is in line 
with the recommendations made by Paterson 


ferred to. The result could however have been 
due to the greater size of the lower-case letters 


ei 
They show that for the newssheets with mixed 
upper- and lower-case headlines, the main 


headlines were located 95; 


Subsidiary headline їп small 
Ower-case letters below its main headline, 

en the Subsidiary headlines were not 
deleted from the newssheets, the relative ad. 
Vantage of upper- to lower-case headlines 
depended Upon whether the stenciled question 
Sheets gave only the main headlines, or in. 
cluded also the subsidiary headlines. In Ех. 
periments 3, 4, and 5, only the main headlines 
were listed on the question sheets, but both 
the main and subsidiary headlines were visible 
on the newssheets, Experiment 3 compared 
the upper-case headlines with the lower-case, 
The results were very similar to those of 


E. C. Poutton 


mu ad- 

Experiment 1 in which the sb 
lines had been deleted from the € here 
lower case 9% faster (р < .05). because 
the interpretation is less clear De strap 
apart from the upper-case onl Fig- 
headline in italics toward the bottom uestion 
ure 2a (which was No. 10 on its The five 
Sheet and most people did not ipe nh on 
remaining subsidiary upper-case hea like the 
the newssheets looked very much П As 
main headlines below which p 
Printed. As illustrated in Figures Ја letters, 
they simply had slightly smaller ith the 
usually about 3.0 mm. tall compared Whereas 
usual 4.0 mm. of the main headlines. head- 
three of the five subsidiary praes M^ but 
lines were in italics (Figure 1f), an nsider- 
the one on the left of Figure 3c were ; having 
ably smaller than the main gre wi 
an x-height of about 1.5 mm., Macon hus 
the usual 4.0 mm. of the main headin adlines 
the volunteers with the upper-case dlines on 
may have searched through more heat targets 
the newssheets in order to locate their er-case 
than did the volunteers with the low 
headlines, 5 4 

As in Experiment 3, in od the 
5 only the main headlines were d sub- 
question Sheets, while both the E news- 
sidiary headlines were visible on t these 
sheets. The table shows that aen rences 
Conditions there were no reliable difi ет-сазе 
between the mixed upper- and T adlines 
headlines and either the all capital he rly it 
or the all lower-case headlines. d а 
would have been necessary to have te foun 
lot more volunteers in order to nave reta- 
reliable differences here, and the interp 
tions would have been complex. iled ques 

In Experiments 6 and 7 the stencile the 
tion sheets carried both the main н each 
subsidiary headlines. The members ет їп 
pair were duplicated one below the 9 news- 
the same relative position as in their m the 
Sheet, but it was not possible to tell vut 
question sheet which was the main an h an 
the subsidiary headline. In the rus ple 
excitement of the experiment it is Dea 
that many volunteers paid particular atten the 
only to the first headline of а pair on ing 
question sheet, and started at once searchi ia 
for it. This favored the upper-case headlines; 


, 


and 
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Since in the five double headlines at the top 
of the newssheets the main headlines always 
came first, as in Figures 1а and b. If the 
volunteer read only the first headline of a 
pair on his question sheet, and then searched 
only the main headlines on the newssheet, 
he would find the main headline he was 
Searching for. Whereas with three of the four 
double headlines at the top of the mixed- and 
lower-case-headline newssheets, the subsidiary 
Strap line came first, as in Figures le and f. 
If the volunteer read only the first headline of 
these pairs on his question sheet, and then 
Searched only the main headlines on the news- 
Sheet, he would be less likely to spot the 
Subsidiary headline which he had read and 
Was searching for, The results of Experi- 
Ment 6 in the one from the bottom row of 
fable 1 are compatible with this interpreta- 
tion. Reliably (р < .001) more headlines 
Were located per minute in the newssheets 
When they were printed in upper case than 
When they were printed in mixed upper and 
Ower case, The difference in favor of the 
Upper-case headlines was the largest in the 
table, 1796. 
, The reliable (p « .05) advantage shown 
Mm Experiment 7 by the mixed headlines over 
е lower-case headlines must be due largely 
to the printing of the subsidiary headlines, 
Since six out of the seven main headlines at 
the tops of the newssheets were identical in 
€ two cases, The three subsidiary strap 
€adlines which preceded а main headline at 
€ top of a newssheet were printed in 12-point 
Capitals in the mixed-headline newssheets 
igure 1e), whereas they Were printed in 
2-point lower-case letters in the lower-case 
Cadline newssheets (Figure 10). Presumably 
When the volunteer had read а subsidiary 
eadline which came first of а раї 01 his 
Westion sheet, and was hunting through the 
main headlines on the newssheet for it, he 
Was more likely to spot the subsidiary head- 
ne if it was printed in small capitals than 
1 it was printed in small lower-case letters. 
is is in line with Paterson and Tinker's 
1946) recommendation that although lower- 
Case letters should normally be used for head- 
ines, capitals can be used occasionally to at- 


Tact attention. 
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In addition to the reliable effects of head- 
lines shown in Table 1, there were always 
reliable effects of order in the analyses of 
variance, and usually also of newssheets and 
of individuals. In one of the seven analyses 
there was a just-reliable (p < .05) triple 
interaction between headlines, order, and 
newssheets. The lettering of the stenciled 
question sheets, whether all capitals or lower 
case (with capitals only for first letters of 
headlines and proper names) and underlined, 
reliably affected performance only in Experi- 
ment 7, where the lower-case sheets come off 
better at the .05 level. The lettering of the 
question sheets did not interact appreciably 
with the printing of the headlines. 


Discussion 


The implications of these results are clear: 


1. If there is a choice between upper and 
lower case, headlines will be more discrimin- 
able when printed as in this experiment in 
large bold lower-case letters than when 
printed in Titling upper-case letters whose 
height is about the same as the x-height of 
the lower-case letters. 

2. If subsidiary headlines are paired with 
main headlines set in lower-case letters, they 
will have a greater attention-getting value 
when printed in capitals than when printed in 
lower-case letters of the same point size. 

3. But if it is the main headlines which 
it is desired to emphasize, subsidiary headlines 
should be regarded as distractors. 
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SOME EFFECTS ON BUSINESS GAMING OF PREVIOUS 
QUASI-T GROUP AFFILIATIONS ' 


SAMUEL D. DEEP, BERNARD M. BASS, лхо JAMES A. VAUGHAN 


А e " h 
Management Research Center, Graduate School of Business, University of Pittsburg. 


93 graduate business students at the University of Pittsburgh ng picis 
to 9 “companies” to play the Carnegie Tech Management Game. s 2 in 
was the major portion of a 15-wk. course in integrated decision-ma e = 
were assigned to “companies” according to whether they had been ш the sa E 
Or different quasi-training (T) groups 15 wk. earlier. "Companies сушр 
of 2 and 3 subdivided quasi-T groups performed significantly тоге effectively 


in the game than "companies" made up of wholly intact quasi-T groups. The 


latter reported less internal conflict but 
panies because of overconfidence in each o 


Much has been written about the effects of 
the existence of subgroup loyalty in the busi- 
ness organization. A general conclusion of the 
research in this area is that subgroup loyalty 
often results in conflict between the overall 
goals of the organization and the goals of 
cliques or departmental groups. In this study 


an attempt was made to create an environ- 
ment where some busi 


$0 as to contain either 
two or three Supposed cliques, 


» “com- 
5 all had been together 
me quasi-T group were 


1 This research was Supported by Contract Nonr 
624(14), Group Psychology Branch. The authors 
wish to thank John Haas, Susan Wolpert, 


and Wal- 
ter McGhee for their assistance in various stages of 
data collection and analysis, The authors also are 
indebted to Richard Karpinnen and Ray Bilski for 


their services as game administrators, 


appeared to be less effective as com- 
ther's dependability. 


a little better. It was thought that such er d 
would have fewer problems in the sonm vs 
cation of ideas and directives and in t E ad 
ordination of company plans and ert | 
necessary in the relatively complex ап uM 
Tech Management Game,? a game pori) 
reasonably valid simulation of the de 
industry. 


METHOD 
Procedure 


er- 

Although the actual experiment involved em " 
formance in а business game over а Em receding 
the experience of the participants in с deca ап 
8 mo. was critica] in the formation a z gradu- 
thus requires some explanation. Ninety-thr quasi- 
ate business students were formed into e the be- 
groups of from 9 to 11 members each, E (They 
ginning of а course in behavioral o 5, .. ® 
Were identified by letter as Group К, pupa 15 wk. 
Group Z.) Each group met twice a ud December. 
during the first term, September throug! ause they 
They are referred to as quasi-T groups pn sprea 
Were trainerless and the group meetings east to à 
Over a considerable amount of time in j^ with in- 
regular intensive 1- or 2-wk. T-group lal 
group trainers, 


of the 


At the beginning of the second term each itself 


nine groups, at the instructor's request, divide 
54 "T 
?For a complete description of the m QR 
К. J. Cohen, W. R. Dill, A. A. Kuehn, EA Game 
Winters, The Carnegie Tech bi. p 
Homewood, Ill: Richard D. Irwin, Inc., 1964. 
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First Term 


Quasi-T Groups of 
9 to 11 Men Each 


Second Term 


Study Groups of 5 
to 6 Men Each 


Third Term 


"Companies" of 9 to 11 
Men Playing the Carnegie 
Tech Game 


Fr 


5 for a course in 
groups met and 
rse of the 15-wk. 


in half, thus forming 18 study group" 
Organizational analysis. These study 
ртератей group papers over the cou 
*m (January through April). | 
. “Or the п ын 1 this study in the third nak 
it was decided to form nine teams 25 follows. Three 
Companies were composed of three intact quasi-T 
Broups from the first term. Three other companies 
Were formed from two of the second-term study 
groups, each of which was from а different quasi-T 
group, The three remaining companies were formed 
by bringing together three-thirds of three, different 
Quasi-T groups. Figure 1 provides а graphic picture 
9f the above description. : 4 
The splitting by self-selection into two study 
Btoups for an additional 15 wk. served to increase 
the possibilities of factionalism under all three con- 


с. 1. Plan of separation and mergers. 


ditions. The intact quasi-T groups faced a number 
of problems: possible guilt feelings about their 
choice of one subgroup over the other when the T 
groups had had to divide; unresolved conflicts and 
resentments over T-group issues which had resulted 
in the mutual rejections leading to the two clusters 
which now had been put back together again; and 
possible unresolved power struggles which were now 
to be renewed. 

The half-and-half teams now had the problem of 
joining two highly cohesive halves of two different 
quasi-T groups together who were likely at this 
time to have different norms, standards, and proce- 
dures. Maximum potential for intergroup conflict 
within the team was likely. 

The “three-thirds” teams were the most fractured 
had the least experience working together, and flus 
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TABLE 1 


EXPERIMENTAL DESIGN: 
INITIAL FINANCIAL POSITIONS ор "COMPANIES" 
AS REFLECTED IN STOCK PRICES 


Industry | $36 | вз | s% 
| | 
1 | R | Sm | vx 
2 | Sm | ux | w 
3 | т | * | & 


Note.— Letters refer to designations of the ex-quasi-T groups 
represented intact, in halves, or thirds in the newly formed 
“companies.” R, W, and Y are intact quasi-T groups. U and у, 

and X, or V and X made up "halí-and-hali' teams and 


Thus, we had three kinds of companies depending on the back. 


had more oi the usual amount of "warming ир” 
to do. 

It was expected that the intact companies who 
had shared common T-group experiences would have 
the mechanisms for dealing with the Possible guilt or 
Tesentment as well as the possible power struggles, 
It was guessed that the familiarity of all 


asi-T groups, 
Design 
The make. 
mtis te ЧР of the Carnegie Tech game made it 


» shown in Tabl P 
each of three industries, A, B, an $ 1, so that in 


merger plans was Combined with one pde. 
financial positions as measured by opening мә өы 
value of the company's stock. Е 

To repeat, competition among teams 
only within each industry, Each company within 
that industry was given a different Past-operating 
history reflected in the differing initial market values 
of the stocks of the companies, One company in each 
industry began the game with the same Past finan- 
cial history. The personnel of one company in each 


took place 


industry began the game with a comparable and 
real-life interpersonal history. 


Objective Measures 


Of the many possible performance criteria - 
judging business firms in competition, the ones ae 
here to compare simulated companies were profits 
earned, ability to forecast sales, control over pro- 
duction costs, and market value of outstanding 
capital stock. These were seen as most likely to be 
sensitive to the differential composition of the com- 
panies and most reflective of the differential success 
of the different companies, 


Profits. All teams within an industry began 2р. 
crating their firms with somewhat different Dn 
histories of Sales, assets, and net worth, but d 
Latin-square design balanced out these effects (assum 
ing there was no interaction between history, vould 
composition, and industry; that is, no errog wou e 
be introduced if the effects of pregame history p 
the same from one industry to the next or pine 
kind of merger plan compared with another. ms 
Was no reason to expect otherwise.). Thus, abso al 
Profits were used as one measure of ame 
Success, recognizing that maximizing total profit a 
not necessarily the most salient or the most x ial 
lant goal of all teams at all times. Certain at 
ratios, such as earnings per share of common 5 lues 
might have been more appropriate, but their оноп 
Were included for the most part in the determina 
of another criterion discussed later—stock prices. 


Forecasting error, A firm's ability in making vid 
tive forecasts was Seen as an indication of беа 
quacy and ease of planning and coordination а on 
its members, Each time that a game-period dec re- 
was submitted to the computer, teams also Beier 
Quired to submit a forecast of what they рее 
sales and profits to be for the coming per tivi to 
percentage of error of the actual sales level rela qu 
the forecast was calculated. The forecasts 07 rofit 
were the ones utilized in this analysis since the E sies 
forecasts were usually very poor for all comp 
involved. 


Avoidable costs. While the costs of poor pem 
do have an eventual effect on profits and ‘other ү they 
cial measures, they are of special interest in ШЕ. the 
give a direct and more detailed indication 0 lace. 
effectiveness of production coordination taking lively 
The Carnegie game does a good job of efec co- 
simulating most of the intricacies of CIA due" 
Ordination, and stabilization needed in the PE 
Чоп planning and control aspect of a typical ane 
facturing concern. In playing the game, ue о 
must be made about such matters as how io oy 
What raw materials to purchase in order to aries 
both Supply shortages and excess storage n о 
how many workers must be hired ог i e 
monthly, and how much finished product is To 
made and supplied to retailers to avoid stockou pic 
quantify the avoidable costs of poor planning W! Fa 
resulted in runouts, unstable employment, and sto 
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outs, an index was calculated to include excess raw 
material and finished goods storage charges, payment 
made for unassigned man-hours and unrealized pur- 
chase discounts.) (Purchase discounts could not be 
realized when a company did not have the cash 
available to pay early or on time for raw-material 
Shipments.) Total costs of poor planning were calcu- 
lated as a percentage of sales since as sales increased 
50 did associated production costs. 


Stock prices. The theoretical market value of each 
firm's outstanding capital stock was computed quar- 
terly (every fourth game month or period). This 
Drice was obtained by increasing the earnings per 
Share of the company over its last 4 mo. of opera- 
tion by a certain multiplier. This multiplier was 
designed to represent а price-earnings ratio and 
ranged between 10 and 20. The price-earnings ratio 
Was reviewed each quarter and was raised or low- 
етей (a maximum oí 10%) according to the firm's 
Current earnings trend, announcements of dividends, 
externa] financing, etc. It was also influenced to some 
extent by an overall subjective evaluation of the 
team’s performance and interest in the game as 
estimated by the game administrators in regular 
meetings with company representatives. The actual 
Stock-value measure used was the percentage of 
Change in stock price at the end of the game over 
what it was at the start. 

The game was played for 30 periods.* 


Subjective Assessment 


A real month after play began, 
period in game time, each participant c 
9llowing questionnaire: 


at about the tenth 
ompleted the 


l. How hard is it for the company as a whole to 


meet face-to-face? 
1. very hard; 2. fairly hard; 3. neither hard nor 
easy; 4, fairly easy; 5. very easy 
- How hard is it for you to contact any other 
member of the company when you need to dis- 
cuss company business? 
1. very hard; 2. fairly h 
easy; 4, fairly easy; 5. Very easy | 
the other men in 
tent do you know 
and likes and 


ard; 3. neither hard nor 


3. How familiar are you with 
your company? To what ex 
their strengths and weaknesses; 
dislikes? 

ey 


3U i mit the cal- 
nfo; у, e did not permit | 
rtunately, the gam ing market 1n cases 


the demand for their 
i ies. This 


n incorporated into 


ended with Pe- 
i t Period 30. The reason 
15 that Period 31 was the beginning of multiperiod 
Moves (two team decisions due simultaneously) and 
Several bugs appeared in portions of the computer 
Program at this time. 
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5. very familiar; 4. fairly familiar; 3. neither 
familiar nor unfamiliar; 2. fairly unfamiliar; 
1. very uníamiliar 

4. How easy is it for you to say what you really 
are thinking to the others in your company? 
1. very hard; 2. fairly hard; 3. neither easy nor 
hard; 4. fairly easy; 5. very easy 

5, How similar are all the men in your company 
in attitudes, values, goals and abilities? 
5. very similar; 4. fairly similar; 3. neither simi- 
lar nor dissimilar; 2. fairly dissimilar; 1. very 
dissimilar 

6. If you were asked to assemble a company from 
the entire class, what are the names of the first 
five men you would pick? 


Company means were calculated for the first five 
questions. The last question, а measure of cohesive- 
ness, Was analyzed according to the differential 
amount of in-company versus out-company choices 
made by each member within a company. 


RESULTS 


Interrelations among Outcomes 


Table 2 shows the intercorrelations among 
the cumulative outcomes for the nine com- 
panies over the 30 periods of play. 


Objective Outcomes 


Improvement in stock prices depended on a 
variety of company financial factors as well 
as instructor judgments about overall satis- 
factoriness of company operations. Neverthe- 
less, it can be seen from the correlation of .94 
between profit and stock prices that cumu- 
lated profits was a paramount determiner of 
gain in the price of stock. As might have been 
expected, these profits and stock prices were 
adversely affected by poor planning (—.53, 
—.57), and lack of forecasting accuracy 
(—.58, —.58). 

It also can be seen that the companies who 
started the game with better stock prices 
were at an advantage. They showed relatively 
more profit (.55) and gain in stock prices 
(.52). They exhibited less poor planning 
(—.45) but were not superior in forecasting 
(—.01). 


Interpersonal Outcomes 


The subjective assessments taken after a 
month of play tended to meaningfully cluster 
together also. Cohesiveness, as measured by 
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| in-group and out-group choices, correlated 
with ease of contact (.75, .60), perceived 
| familiarity, openness, and similarity (.82, Ah 
= 42). Familiarity related to ease of group ап 
individual contact (.46, .58), but openness 
Primarily was associated with ease of indi- 
vidual contact (.51) although the latter was 
-— related to ease of group contact (.60). Oper 
ness and perceived similarity were positively 

related (.67), 


ness 
1 


Cohesive- 


Perceived 


Perceived 
openness 


— 9€ Objective versus Interpersonal Outcomes 


" à k 
а-о Contrary to expectations, profits and stoc 

EX Prices were higher in those companies whic 
Were seen by their members to be divided, 


Perceived 
familiarity 


TABLE 2 


I" that is, not Similar in attitudes, values, a? 


= 
23 а |55825 goals (—.61, —.75). Perceived openness p 
звер рг” Pew In Saying what one thought hindered, са 
з= eg a 2 "a eia success (—.42, Maie 
ATA NM | felt open (66), sie fastos rots wee 


Sreater in the more cohesive companies 

and where group and individual contacts Were 
a casier (.75, 63). In short, better interpet- 
T Sonal relations tended to go hand in han 
d With poorer business decisions. 


Starting 
price 


u Experimenta] Effects 


m 

Se |t , А 5 

$5 |56 & КР Was expected, the intact quasi-T id 

$$ ү Hos “port the greatest interpersonal satisfa 
a 


compared to the halves of two quasi- 


. = пя Ог the three-thirds of quasi-T groups- 
5 greater, more openness 

ee Seen, greater similarity of attitudes and pur- 

== Dose was Perceived, and more in-group rather 

| than out-group choices were made by Де 

fully reconstituted Т groups. Probabilities 

that the means shown were distributed by 


Forecast 
error 


Costs of 
poor 
planning 
—.53 


chance also аге noted in Table 3. 

At the same time, Table 3 is consistent 
with the intercorrelation analysis in that Ше 
reverse trend was apparent in the effective- 


Profit 


Propuct-Moment CORRELATIONS AMONG THE OBJECTIVE AND SUBJECTIVE MEASURES OF Company PERFORMANCE (N 


ness of the business decisions made БУ the 
three types of companies. The intact quasi- 
8roups lost 5.37 million dollars instead 0 
showing Profits as did the other types. They 
had the highest costs due to poor planning, 
exhibited greater sales forecasting error, an 
yielded the least gain in stock value. 

These generally statistically significant re- 
sults could not be attributed to initial differ- 


h 7 df; r = .75. 


© 
» 
u 
` 
E 
` 


Measure 


E 
1 
x 
| 
& 
É 


*p «.05 
*kp <.01 wi 


Perceived familiarity 


Costs of poor planning 
Individual contact ease 
Perceived openness 


Forecast error 
Gain in stock price 


Starting price 
Perceived similarity 


Group contact ease 
Cohesiveness 


Profit 


pL s —À 
——— ——PR a 


TF 


Group AFFILIATIONS AND BUSINESS GAMING 


TABLE 3 
DIFFERENCES BETWEEN COMPANIES BALANCED BY 
INDUSTRY AND INITIAL FINANCIAL POSITIONS 
ACCORDING TO THE BACKGROUNDS OF 
THEIR MERGED SUBGROUPS 


Backgrounds of merged subgroups 
Halves of | Thirds of 
Intact, | two three A 
quasi-T | quasi-T | quasi-T | (N =9 
groups groups groups 
(n =3) | (n =3) | 0 =3 
Business E > P 
Profits (i 
in 5.37 1.97 олт | 108 
3.30 0.97 2.73 2.33 
56.00 18.30 20.60 | 31.70** 
Gain in stock " AT 
prices 0.55 2.08 1.47 1. 
Interpersonal 
Troup conta 
NS i 3.26 2.41 2.38 2.68** 
ndividual con- * 
ptt ease 3.76 3.26 2.86 8:29 
erceived * 
familiarity 4.26 3.75 3.44 3.82 
erceived open- " " 
B ness PRAT 4.06 3.18 3.76 3.87 
erceived А .84 
similarity 3.08 2.66 218 e 
Ohesiveness 2.96 1.81 4 
* 
«.05 
жка < .01 


ences in the ability or intelligence of the pe 
ticipants. Corresponding Latin-square ms y- 
Ses of the companies according tO eir 


d- 
members? intelligence-test scores (on the A 


missi ate Schools of Busi- 
py oai, = erages failed to 


ness) and their grade-point av = 
reveal any differences. In fact, the Е. Es 
Of mean intelligence and grade-poin т 
ages of the companies were very near A " 
Game administrators who observe m 
teams in action felt that the ae? er 
groups tended to have too many а ji ni 
not enough Indians. The net тези oe 
ability to effectively organize themse 


the real work to be done. Опе рена os 
intact quasi-T group complained = ше 
game that his company’s consisten i 
performance was due to the fact 

knew his teammates t00 well to 


control or organize them effectively- 
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not needle them for the required amount of 
work that each had to do if adequate de- 
cisions were to be made. 

The mergers of men from different quasi-T 
groups resulted in more structured organiza- 
tions. Chief executives were more willing to 
prod subordinates into producing. More im- 
portant, they were concerned about control 
and follow-up. A common problem in the 
companies of men all from the same quasi-T 
groups was that when a president asked a 
colleague to complete some analysis, the 
president assumed too readily that the analy- 
sis would be completed on time as requested. 
There was a reluctance in these companies to 
initiate and enforce controls that other-type 
companies used to achieve better decisions. 
In a sense, there was too much trust and con- 
fidence that fellow company members would 
do their share so that the company would be 
prepared when deadlines occurred. Among 
companies of men from different quasi-T 
groups there was more dependence on man- 
agement controls and less on familiarity, ease 
of contact, or perceived similarity of goals 
and attitudes. 

If the results obtained here can be re- 
peated under similar conditions, they sug- 
gest that in groups called upon to make many 
complex decisions under considerable time 
pressure, the familiarity, cohesiveness, and 
ease of communications generated by common 
previous T-group experience may hinder 
rather than help generate adequate decisions.? 


5 It should be emphasized that it would be a mis- 
take to infer from these results that T grouping, 
per se, contributes to organizational ineffectiveness. 
Rather, as suggested elsewhere by one of the authors, 
the T-group experience may or may not be useful 
{ог organizational development, depending on what 
other approaches are followed along with it. For 
further discussion about this, see B. M. Bass, The 
Anarchist Movement and the T-Group: Some Possi- 
ble Lessons for Organizational Development. Ap- 
plied Behavioral Science, in press. 
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INFLUENCE OF FAVORABLE AND UNFAVORABLE 
NFORMATION UPON ASSESSMENT DECISIONS 


JAMES W. MILLER axp PATRICIA M. ROWE 


University of Waterloo, Ontario 


favorable adjectives and 1 unfavorable 


of the Type 3F-2U and 3F-3U, 30 Ss 


30 Ss to descriptions of the Type 1F- 
of the 3 conditions (3F-2U, 3F-3U, 2F-3U, 1F- 
were more influential upon the assessment than 


The significance of the results 
interview was discussed. 


Personnel interviewers and other individu- 
als who have been concerned with making 
assessment decisions have Suggested that un- 
favorable information about an individual is 
more influential in making a decision than is 
favorable information. Yet the literature con- 
cerned with the employment interview has 
only indirectly tested this notion. It was an in- 
cidental finding of Crissy and Regan (1951) 
which suggested that 
rely more upon unfavorable evidence about 


(Springbett, 1958) that the employment in- 


terview is primarily a search for negative in- 
formation. That is, the i i 


Bolster and Springbett (1961) tested the 
notion that an early positive decision in the 


employment Situation could be reversed easier 
than an earl i 


information to 
shift the decision from negative to positive. 
1 This article is based on a thesis submitt, 
senior author to the faculty of graduat 
the University of Waterloo, Waterloo, 
partial fulfillment of the requirements fo 
of Master of Arts. The present тезеагсһ was Sup- 
ported by Grant Number 9401-27 from the Defence 
Research Board of Canada to Patricia M. Rowe, 


ed by the 
€ studies of 
Ontario, in 
r the degree 


for assessment 


to descriptions of the Type 2F-3U, and 
3U. The results demonstrated that in 4 


3U) the unfavorable adjectives 
were the favorable adjectives. 
decisions in the employment 


For those Ss with an experimentally apo 
Positive decision, the shift from тат ee 
hegative required only 3.8 items of a “ae 
able evidence, Thus, their results eT us 
Port to the notion that unfavorable evi anal 
is more influential upon the interviewer’s 

decision than favorable evidence. А tiga- 

In the area of person perception, inves dif- 
tors have also been concerned with the de- 
ferential influence of traits. Asch psum n 
veloped the concepts of "central" and К» 
ripheral” to refer to traits which А йи 
respectively, great influence and little in ea 
ence. His problem was to determine hov A 

Organizes a series of trait names om 
Single person into a unified impression; = of 
Specifically, he was interested in the effec ing 
changing one trait into its opposite, keep at 
the other traits the same. The changing in 
Some traits produced marked rune а 
final impressions while the changing of ot jt 
Produced little change in final —— 
Asch concluded that a trait can be eit in 
"central" or "peripheral? to the perceiver ef 
its influence on the final impression. Wishn : 
(1960) examined Asch's data and found Fa 
there was no way to predict which tral Е 
would be central and which would be jl 
ripheral without individual measures fron 
each S on the associations among traits. 

A further reanalysis of Asch's data does; 
however, indicate that the differential influ- 
ence of favorable and unfavorable traits upon 
the final impression can be Predicted. The 
unfavorable characteristics in a description 
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Served to lower the favorableness of the fa- 
beni characteristics far more effectively 
inf the favorable characteristics lessened the 
ж of the unfavorable charac- 
likel "a Thus, the unfavorable adjectives are 
fuer to be central” and the favorable adjec- 
Em are likely to be "peripheral." A study br 
that er, Shapiro, and Tagiuri (1958) showed 
en One can also predict the kinds of infer- 
Ces drawn from trait names. Their results 
Более that the combination of a favor- 
Tes an unfavorable trait will lead to in- 
Mira of the same sign (favorable or un- 
ties able) as the trait that led to the larger 
Vorable of inferences in isolation. The unía- 
in Шер. traits generated 50% more negative 
роко 5 than favorable traits generated 
avorah inferences. Thus, it appears that un- 
Vorab l traits are more influential than fa- 
anot e traits to an individual when judging 
Al 1ег person, 
comme Ugh the data from experiments con- 
| With decision making in the employ- 
der interview or person perception can га 
тайы Teted to show that the unfavoral e 
is will be more influential to the observer, 
interpretation is post hoc and has not 
With tested systematically. This study deals 
tha а Specific type of assessment decision— 
+ assessing individuals for suitability as 
m Mates—and undertakes a direct and sys- 
atic investigation of the differential effects 
on erable and unfavorable informa Он 
that assessment decisions. It is урин. 
ei iem an individual makes а decision 
infor another person, on the basis of par ial 
able mation about that person, the unfavor 
9n t evidence will have the greatest influence 
he decisions, 


PROCEDURE 


І r а 
а" the present study, Ss were presented with wel 
Whig “scriptions of prospective roommates, -— 
decisio 0 апей а number of traits. The Ss > d 
Cach «15 aS to whether or not they would aa 
deseri Person” as a roommate. For each e NS 
ае Поп à measure of favorableness or Шау 

ad b i obtained. 

Uni ection pere Twenty 55 at the 
Goy “у of Waterloo rated 299 adjectives from x 
tangin (1952) Adjective Checklist on а 7-point _ 
hey © from very favorable to very unfavorable. 

via Were instructed to consider each adjective m- 
“ally and to make their decisions 45 if the 


adjectives were descriptive of a person. Ambiguous 
adjectives were placed in a separate category. 

The mean rating and standard deviation were cal- 
culated for each of the adjectives. Ninety-nine adjec- 
tives, those receiving one or more ambiguous ratings 
and those with a standard deviation of greater than 
1.0, were then eliminated from the list. This was 
done to insure that the adjectives used in the de- 
scriptions were those about which considerable agree- 
ment existed as to the degree of their favorableness 
or unfavorableness. The remaining 200 adjectives 
constituted the adjective pool for constructing the 
descriptions. 

Construction of the descriptions. Using these ad- 
jectives and their mean ratings, 5 groups of 100 dif- 
ferent descriptions of prospective roommates were 
prepared. 

For Group I, 10 sets of 3 favorable (F) and 10 
unfavorable (U) adjectives were selected. Within 
each set the adjectives had approximately the same 
mean rating. Adjacent sets were separated by a dii- 
ference in mean rating of approximately .30. To 
construct the 100 descriptions, each of the 10 sets of 
favorable adjectives was paired with each of the 10 
unfavorable adjectives. Thus, each description in 
Group I was composed of 4 adjectives, 3 favorable 
and 1 unfavorable (3F-1U). These 100 descriptions 
were then randomly ordered to make up Form A 
of the test materials. 

The descriptions in Groups II, III, IV, and V 
were constructed by adding 1 or 2 unfavorable ad- 
jectives to or by eliminating 1 or 2 favorable adjec- 
tives from each description in Group I. Thus, each 
description in Group II was composed of 5 adjec- 
tives (3F-2U), each description in Group III was 
composed of 6 adjectives (3F-3U), each description 
in Group IV was composed of 5 adjectives (2F-3U), 
and each description in Group V was composed of 
4 adjectives (1F-3U). As with Group I, within each 
set in Groups II, III, IV, and V the adjectives had 
almost identical mean ratings and adjacent sets were 
separated by a difference in mean rating of approxi- 
mately .30. 

Alternate descriptions were selected from Groups 
II and III and randomly ordered to make up Forms 
B and C of the test materials. Thus, Form B and 
Form C consisted of 30 descriptions of the Type 
3F-2U and 50 descriptions of the Type 3F-3U. The 
same description did not appear on both forms. 

The descriptions from Group IV (2F-3U) were 
randomly ordered to make up Form D and the de- 
scriptions from Group V (1F-3U) were randomly 
ordered to make up Form E of the test materials. 
See Table 1 for a summary of the nature of the test 
materials. 

The rating scale. A 6-point rating scale was used. 
The task of the S was to decide the degree to which 
he would or would not consider each “person” as a 
roommate and record his decision from 1 (definitely 
would consider this person) to 6 (definitely would 
not consider this person). 

Subjects. The Ss were 145 undergraduate students 
in the introductory psychology course at the Uni- 
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TABLE 1 
SUMMARY OF THE TYPES or TEST MATERIALS 
Form | Type of description| No. descriptions 
A 3F-1U 100 
B 3F-2U 50 
3F-3U 50 
G 3F-2U 50 
3F-3U 50 
D 2F-3U 100 
Е 18-30 100 


versity of Waterloo who received class credit for 
participating in the experiment. 

Method. 'The test materials were presented to Ss 
in group sessions. Thirty-two Ss responded to Form 
A of the descriptions, 27 Ss responded to Form B, 
26 Ss responded to Form C, 30 Ss responded to 
Form D, and 30 Ss responded to Form Е. The Ss 
were given the forms, asked to read the instructions 
carefully and respond to all descriptions. 

Scoring of responses. In cach group of 100 de- 
scriptions, each set of favorable and each set of un- 
favorable adjectives appeared in 
Summing the decisions to the 10 d 
taining a particular set of adjectives 
decision response (mdr) for all descriptions contain- 
ing that particular set of adjectives. For example, in 
descriptions of the Type 3F-1U the set of favorable 
adjectives honest, intelligent, original appeared in 10 
descriptions. The mean of the 10 responses by an 5 
to these descriptions is the mdr for the set of adjec- 
tives honest, intelligent, original. This procedure 
was followed for each set of favorable and each set 
of unfavorable adjectives for Ss individually for 
each of the five types of descriptions. 


10 descriptions. 
escriptions con- 
gave the mean 


RESULTS 


ure was obtained by 
al rating of the adjec- 
decision Tesponse (mdr) 


tho: containing the particular 
adjectives for each S. Since the responses of 


each 5 were scored to provide an mdr to each 
of the 10 sets of favorable and each of the 10 
sets of unfavorable adjectives, two correla- 
tions were obtained from each § in each con- 
dition. The first, umar, was the correlation 
between the ratings of the unfavorable adjec- 
tives and the mdr’s to the descriptions con- 


correlating the origin. 
tives with the mean 
to those descriptions 
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taining those adjectives. ‘The second, iH 
was the correlation between the ratings of : 2 
favorable adjectives and the mdr's to the Н 
scriptions containing those adjectives. А ign 
tive correlation indicates that the mdr a 
creases (more descriptions are rated ш 
ably) as the adjectives become less ае 
or more unfavorable. Any difference, page el 
tween Fumar and 7; маг Would reflect a di d 
ence in the use to which the favorable p 
unfavorable adjectives are put. Thus, т 
class of adjectives having the higher corre ч 
tion between their rating and the mdr a 
them are influencing the decision proce 
most. The median and range of 7u.mar es 
7t.mar for the five types of descriptions appe 
in Table 2. т: 
Reaction to favorable and unfavorable d 
jectives. Differences between the cr 
Ss having rymar greater than remar ай {ог 
number of Ss having ғ, маг less than ^im s 
each type of description were tested by = is 
of x? tests. The summary of these x° ati 
shown in Table 3. A greater number oe 
responding to descriptions of the Type a 
1U had correlations between mdr and fav " 
able items larger than correlations betwe 2 
mdr and unfavorable items than yieee 
Thus, for most of the Ss (68.5%) the fav 3 
able adjectives were most influential. By СО g 
trast, for a greater number of Ss respondin 
to Descriptions 3F-2U, 3F-3U, 2F-3U, к 
1F-3U the correlations between mdr ne 
items were larger for the unfavorable ite : 
than vice-versa. In these latter four ue 
therefore, the unfavorable adjectives W 65, 
more influential than the favorable ade. 
The stronger influence of unfavorable d ] яз 
tives for most of the Ss increased steadily m 
the proportion of unfavorable adjective’ es 
creased. Thus, the unfavorable adjec 


TABLE 2 


MEDIAN AND RANGE ОЕ Tu.mdr AND ff.mdr 
ЕАСН TYPE or DESCRIPTION 


FOR 


rfmdr 

Items in Tostde 

descrip- & 
Чоп e| des Range мап Rang zi 

m 

= 593 | —.319 to 4-890 | 728 .399 to "$3 

3E-2U -825 | 4-250 to +.986 | ‘sg T$ to +010 

3E-3U | .857 | +.210 to +.920 | “393 | — 330 to 1922 

28-30 | -851 | +.462 to -Кобз | 712 4:021 to 1599 

1Е-30 | .883 | 3.716 to -L.958 | 5512 | 1:050 to + 


INFLUENCE OF INFORMATION UPON ASSESSMENT 


TABLE 3 


TABLE OF x? TESTS BETWEEN SUBJECTS HAVING 
Tu.mdr > {маг AND Tu.mdr < {шаг FOR 
Eacu Tyre or DESCRIPTION 


ao in | Frequency of | Frequency of 52 
SScription | ru ar > тае | Tu.mdr зае 
3F-1U 10 22 4.50* 
3F-2U 43 10 20.55** 
3E-3U 43 10 20.55** 
2F-3U 27 3 19.20** 
18-30 28 2 21.87** 
ib < .05 

** Soo 


с most influential for 81% of the 55 їп 

th, SF-2U and 3F-3U conditions, 90% oí 
жы in Ше 2F-3U condition, and 93% of 
© Ss in the 1F-3U condition. 


DISCUSSION 


" general purpose of the present investi- 
асын Was to determine whether certain char- 
Tistics of a person are more distinctive 
m Others and, hence, more influential in 
termining the assessment decisions made of 
Bx Person by another. The main results are 
аг. The hypothesis is strongly supported: 
than favorable adjectives carry more prn 
Pro, Ше favorable adjectives and exert а is- 
їо, Portionate influence on assessment deci- 
n ү sy f the five con 
. 18 effect appears in four of the - 
prions (35-20, 3F-3U, 2F-3U, 1F-3U). 
П these conditions, for a significantly greater 
Feet of Ss the highest correlations are 
‘ith unfavorable adjectives. These results in- 
‘Cate that favorable adjectives produce less 
"ect variation in response than do the un- 
Worable adjectives. н 
the present results can be generalized to 
SCision making as it occurs in the employ. 
ent interview. First, this study has extende 
© earlier results (Bolster & Spring 
961) which suggested that the unfavorsl e 
Vidence in the interview exerts more ІП u- 
°псе than does the favorable evidence, upon 
i decision. Their results only showed this 
к true, however, when the interviewer ha 
ade а reliminaty decision and the unfa- 
zen vi r. In the pres- 
able evidence appeared Jate: о. 
ent study, the undue influence of the unfavo! 


1 
е 
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able evidence was also shown to exist when 
all of the available evidence is present and 
the interviewer can review it before making 
his decision. 

Second, it is inferred that in basing their 
decision on the unfavorable adjectives, the Ss 
tended to select those “roommates” who were 
not bad and tended to reject those who were 
bad. The same inference can be drawn for 
those decisions made in the employment in- 
terview. The decisions of the interviewer may 
have consequences not only for the applicant 
but for the interviewer himself. For instance, 
the interviewer may receive negative rein- 
forcement for choosing a poor applicant and 
little positive reinforcement for choosing a 
good one. If the applicant is largely íree 
from unfavorable characteristics the inter- 
viewer can accept him for the position with 
little fear of negative reinforcement. He thus 
tends to search for applicants who are not 
bad instead of applicants who are good. 

In conclusion, this study demonstrates that 
when an individual must evaluate another in- 
dividual on the basis of limited information, 
and when that information contains both fa- 
vorable and unfavorable evidence, the evalua- 
tion will be influenced more by the unfavor- 
able evidence than by the favorable evidence. 
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COMPARISON OF PERFORMANCE OF SALES TRAINING 


GRADUATES AND NONGRADUATES 


WARD A. HARRIS! axp NORMAN L. VINCENT 


State Farm Insurance Companies, Bloomington, Illinois 


man for man on state of residence, age 


earnings from the sale of auto, life, а 
begun. Performance comparisons were 
and the year it was completed. Whil 


during the year the sales training was begun, the trained grou; 
life insurance premiums, 


nificantly more Ist-yr. 
policies, during the year training was 
ing, 2 other possible reasons for these 


Training of life insurance agents is usually 
spoken of as imparting two distinct kinds of 
knowledge, technical knowledge about life in- 
surance and sales knowledge about life insur- 
ance. Technical knowledge concerns the facts 
about what insurance is, while sales knowl- 
edge deals with the approach to selling it. It 
is meaningful to consider the two kinds of 
knowledge separately when evaluating their 
importance for performance as an agent. 

It appears that most investigations of the 
importance of life insurance knowledge for 
performance as an agent have dealt exclu- 
sively with technical knowledge. Such investi- 
gations have attempted to find the relation- 
Ship between scores on a test of life in- 
surance knowledge and various measures of 
performance as an agent. The Life Insurance 
Agency Management Association (1952) re- 
ported a slight 
test score and 
ship did not h 
Insurance Age 
1957). Result: 


Baier and Dugan (1956) repor 
lationship between test scor 
and in a later study (195 
nificant relationship betw, 
production, and a positi 


ted a Slight re- 
е and production, 
7) reported а sig- 
een test score and 
ve relationship be. 

1Now at Litton Scientific Su 
Fort Ord, California. 


Pport Laboratory, 


insurance sales training course) 
performance, 88 LUTC graduates were 
nongraduates. The groups were matched 
when appointed, length of service, and 
nd fire insurance in the year LUTC was 
then made for the year LUTC was begun 
e the groups performed about the same 
p produced sig- 
on significantly larger Ше 
completed. In addition to the sales train- 
results are discussed. 


1 
tween test score and persistency. In Lies 
then, the evidence appears consistent in hnic 
ing positive relationships between tec Wi 
knowledge and life insurance peat 
is contradictory concerning the vr ges ua 
between technical knowledge and produc ales 

The present study was concerned with 5 at- 
knowledge about life insurance, and s Teva 
tempt was made to determine if a higher. as- 
of sales knowledge about life insurance che 
sociated with better performance as an bcr 
The study dealt with a particular sales tT ink 
ing program, the Life Underwriter Tm 
Council Course (LUTC). This is a 2-yr. 5 21- 
training program consisting of 25 weekly urse 
hr. classes each year. Emphasis of the wc 
is on development of sales skills. i aei 
time is spent on text books, case histor 
field projects, апа class discussion. 


МЕтнор 


TC 

The question was posed simply as: do pes 
graduates perform better as agents than do 

graduates? " nts of 

Subjects of the study were multiple-line ei cated 

State Farm Insurance Companies, and aig os per- 
in 25 different states across the country. Т 


1 Г study 
formance measures of special interest in the 
were: 


1. First-year life insurance premiums produced: Ь 

2. Average size of life insurance policy produ 

3. Number of life insurance policies producec. ere 

4. First-year and second-year life insurance P 
sistency? 


? First-year life insurance 
as the proportion of life ins 
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2 ей 
Dersistency is meas 
urance issued in a gt 
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3. / i : : 
Auto insurance production and auto loss ratio.? 


6. Fi a 5 
П Fire insurance production and homeowners 
oss ratio,t 


fone’ procedure followed was to observe the per- 

agents ed of two groups of agents, a group of 88 

ТС. о had graduated from LUTC in May 1964 

Who кей не ЫП and a matched group of 88 agents 

Matchine not graduates of LUTC (Control group). 

Variables was done man for man on the following 
during the year LUTC was started. 


i е of residence. 

: i When appointed as an agent. 

й тач of service. 

be poal earnings from the sale of auto, life, and 

LUTC urance in year LUTC was begun by the 
Braduate, 


To Р . 
оп determine if the groups were essentially alike 


the me matching variables, tests of significance of 
ducteq " difference between the groups were con- 
Stoups ке each variable (see Table 1). The two 
Ing vari EN found to be well matched on all match- 
toup E les except length of service. The Control 
cantly Jo Nongraduates had, on the average, signifi- 
ter 1807 service than the LUTC group. 

Sonably ascertaining that the two groups were rea- 
ance y, Well matched, their success on the perform- 
wade mes was compared. Comparisons were 
Sarteq Oth for the year the LUTC course was 
Pecteq and the year it was completed. It was ex- 
form, that both groups would improve their per- 
“ацы during the interval between comparisons 
has af Of their increasing experience, but if LUTC 
ance sha cradle result, the LUTC group’s perform- 

Ould improve more. 


ar that i 
Seco qat is still in force at the end of that year. 


31 Е life insurance persistency is measured 
i n t » 
year th portion of life insurance issued in а give 


Year, at is still in force at the end of the following 


? Auto ; . 
i ante Msurance production is measured in terms 
suran. Career points earned. In essences 2 auto 
instar, Career points are awarded for each new, 
апо, ted, and added section of automobile insur- 


Ац 
z zi | | 
це paranee loss ratio is the ratio of parie 
b. uas ied 
py Year, a given year to total premiu 


lre į ‚ 
9 ei "р" terms 
йге DSurance production is measured in 


Palic © carcer points earned. Each new and renewal 
= fol ‘sued and credited is associated. with points 
xe fire insurance = 1 career point, home- 
7 4 career points, and specia 
ы аа kou Career points. : 
i x Credit inuous homeowners policy; 
? Sura с *d at 3-уг, intervals. When th des 
‘ditional principal dwelling is $15,000 °F more, 
° al career points are added. А 
total Meowners i шш loss ratio is the ratio of 
Ming, OSES incurred in a given Year to total pre- 


ĉarned in that year. 


аде = 
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TABLE 1 


DIFFERENCES BETWEEN LUTC GROUP AND CONTROL 
GROUP ON THE MATCHING VARIABLES 


Variable |рррс|сопны| 4 | SD i 

| 

State of resi- | 

dence* П 

eee 319] 320 | -O1] 29) сш 

ment (yr.) » 

Length of ser- sa| 65| -o:| -33| 212* 

vice (yr-) 

TOR паз | $7837 | $8528 | —S691 | 397.66] —1.74 


Note.—N = 88. : 
а Groups were perfectly matched on state so no significance 


test was necessary. 4 
b Student's ! test of the mean difference between groups. 


жр < .05. 


Table 2 shows data and significance test results of 
comparisons of the performance variables. Signifi- 
cance tests could not be conducted on two of the 
variables, size and number of life policies, for the 
beginning year, because of lack of data on indi- 
vidual group members. Rough estimates of the av- 
erage performance on those variables, however, ap- 
pear to be quite similar. On those variables for 
which “ratio scale" measurement was available, t 
tests of the mean difference between groups were 
conducted. Wilcoxon matched-pairs signed-ranks 
tests (Siegel, 1956) were used on those variables for 
which "interval scale" measurement was available. 

Though each of the groups contained 88 agents, 
complete data were not available for every agent 
on every variable. Where data were missing for one 
or both members of a matched pair, the pair was 
excluded from the analysis. Thus, the V used in the 
{ tests varied from 84 to 88 as can be observed in 
Table 2. The N used in the Wilcoxon tests also 
varied from 84 to 88 for the above reasons, and 
were further reduced by the number of pairs with 
a difference of zero as required by the test. 


RESULTS 


During the year LUTC was begun, the av- 
erage first-year life premiums produced by 
the two groups were essentially the same. The 
mean difference of $28 in favor of the Con- 
trol group was not statistically significant. 
During the year the LUTC group finished its 
course of study, 2 yr. later in most cases, the 
mean difference was significant. Both groups 
showed an increase in average first-year life 
premium Over the 2-yr. period. While the 
Control group's increase probably illustrates 
a normal increase over time, the LUTC 


group's increase is greater, and this is asso- 
ciated with the fact that they graduated from 


LUTC. When it is remembered that the 
LUTC group had a shorter average length of 
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TABLE 2 


DIFFERENCES BETWEEN LUTC Group 


AND CONTROL GROUP ON THE PERFORMANCE VARIABLES 


T? x E v * 
Variable N |XLUTC|ÉEConrd| Za SD Е 
: н Fer | | | s 
First-year life premium in: ‚у —.35 
year LUTC began 84 | 81521 | $1549 | —s2s 20502 2.36" 
year LUTC finished 86 2387 1991 | 396 | 107.54 
Size of life policy issued in: 595 | — 
year LUTC began 88 $5696 5605 jn n A3* 
year LUTC finished 86 8281 7359 922 378.96 T 
No. life policies issued in: — 
year LUTC began 88 13.5 13.1 = ин 74 
year LUTC finished 86 18.0 16.9 IBI 149 
Auto career points earned in: —,51 
year LUTC began 85 213 1245 -3 62.84 —24 
year LUTC finished 88 1242 1257 -15 63.47 
Fire career points earned in: | 31 
year LUTC began 85 227 222 | 5 1605 1.18 
year LUTC finished 88 384 355 29 24.50 
E 
c 
Life persistency ratio (first year) in: 80 
year LUTC began 60 .92 91 => = кё 32 
year LUTC finished 65 93 94 = = s 
Life persistency ratio (second year) in: 1.46 
year LUTC finished 82 78 80 — = Е 
Auto insurance loss ratio in: 1.87 
year LUTC began 82 45 51 E" = 7) 
year LUTC finished 87 50 ‘60 = = = 
Homeowners insurance loss ratio in: 34 
year LUTC began 82 .50 57 -= E L 26 
year LUTC finished 86 45 ‘68 = — prà 
* Student's ¢ test of the mean difference meme = B 
ULT d s matched-pairs signed-ranks test of the difference between group means. 


difference between groups, 
The average numbers of life Policies for the 
two groups were nearly identical during the 


5 
Year LUTC was begun. While both ed 
increased their averages during the отор 
tion year, the mean difference between 8 zero. 
Still was not significantly different etn 
Therefore, there is no evidence that 8 reater 
tion from LUTC is associated with à г 
than normal increase in average num 
life policies issued. 


> cony 
First-year life insurance persistency The 
parisons are also shown in Table year 


difference between groups during ed the 
LUTC was begun was not significant. ups P 
Year LUTC was completed, both ж рш 
Creased their first-year life persisten h the 
neither group did significantly better є gradu 
other. From these data, it appears that P ith 
ation from LUTC cannot be associate” псу ; 
significantly better first-year life pers! 
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It was thought that a greater difference be- 
tween groups might show up if one looked at 
second-year persistency. 
сак be seen in Table 2, both groups had 
than end Jower second-year persistency 
ощ F did first-year persistency. Both 
Re: suffered about the same de- 
оч һе difference between the two groups 
signifi -year persistencies is not statistically 
insur cant. It might be speculated that life 
нра persistency of the two groups will 
bud. as more time passes. Perhaps third-, 
significa or fifth-year persistency will show a 
now а difference. The evidence available 
tion i not appear to support such specula- 
аз с nstead, it points to chance fluctuation 
cr the only difference in persistency 
reg the two groups. 
б us now look at auto insurance produc- 
Mi auto insurance loss ratio. As noted 
nee auto production is measured in 
seen 5 of auto career points earned. It can be 
Was be Table 2 that during the year LUTC 
aye, eum the Control group earned, on the 
etage, 32 more auto points than did the 
robes group. During the year LUTC was 
15 Pleted, the Control group’s lead was only 
hen on the average. Before applauding 
eve aster increase of the LUTC group, how- 
n т, it should be noted that the mean differ- 
Ces between the two groups, both when 
"en, was started and when it was com- 
асот are not statistically significant. Thus, 
Mer eive statement of greater auto-pro- 
ы On growth for the LUTC group is pre- 
"ded, 
The situation is similar for auto loss ratio. 


a * Control group showed, on the average, à 
"ger loss ratio the year LUTC was started, 


а during the year of completion the aver- 
^ loss ratios were nearly identical. Again, 
be drawn 


а monly strong conclusion that can ^. 
in Ut the two groups is that their difference 
" loss ratios was “due to chance,’ bot 
Co; €n LUTC was begun and when it was 
a Mpleted. Thus, no change сап definitely be 
Ssociated with LUTC. 
Отрагіѕопѕ of average fire insu 
ax Anf, indicated as fire career poin 
Те shown in Table 2. In the Year LUTC was 
gun, the difference between average fire 


rance pro- 
ts earned, 
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points for the two groups is very small and 
certainly not significant. During the year 
LUTC was completed both groups show an 
increase in fire points, but the mean differ- 
ence between the two groups is still not sta- 
tistically significant. So, although the LUTC 
group shows a slightly larger increase in 
points earned, it is probably a chance occur- 
rence. 

Looking at homeowners loss ratio, one sees 
that the LUTC group had a slightly lower 
loss ratio when the LUTC training was be- 
gun. When training was completed, however, 
the LUTC group had a slightly higher loss 
ratio. This appears to be chance fluctuation 
since neither of the differences is statistically 
significant. The inference that must be drawn 
from these data is that LUTC has no signifi- 
cant association with homeowners loss ratio. 


DISCUSSION 


It can be concluded on the basis of these 
comparisons that the LUTC group performed 
better on two important aspects of life in- 
surance production. Caution should be used, 
however, in concluding that better perform- 
ance was necessarily a direct result of LUTC 
participation. It may be that the kind of 
agents who produce better are also the kind 
who choose to attend LUTC. There may be 
a factor of "interest in life insurance" which 
is basic to both attendance of LUTC and pro- 
duction of life insurance. 

The possibility of an “interest factor" is 
strengthened by the fact that the LUTC 
group had the same average level of produc- 
tion as did the Control group during the year 
LUTC was begun, but had a significantly 
shorter average length of service. For the 
LUTC group to reach the same level of life 
production in а shorter period of time, there 
probably was some factor such as "interest" 
spurring them on. If an “interest factor" is 
operating, the LUTC group might have per- 
formed better than the Control group even if 
they had not attended LUTC. 

However, if higher “interest in life insur- 
ance” is inferred from the LUTC group's 
faster increase in life production up to the 
year LUTC was begun, the same reasoning 
may apply to auto and fire production. The 
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TABLE 3 


INTERCORRELATIONS ОЕ CAREER 
POINTS EARNED IN 1 YEAR 


Life Fire 
Auto | .60* .68* 
Life | — 45* 


У Term premium). 
d in previous foot. 


LUTC group required less time than the Con- 
trol group to reach the same level of auto and 
fire production, and, therefore, must have 
higher “interest in auto and fire insurance,” 
It is quite possible, then, that the LUTC 
group did have higher "interest in life insur- 
ance" than the Control group, but apparently 
this interest extended to auto and fire insur- 
ance as well. 

Assuming that the intere 
LUTC stoup toward auto а 


Average life pro- 
duction of the LUTC Population might be 


| е 

higher than the Control population's s 
both during the year LUTC was bs The 
well as during the year it was complet ` pro- 
reason the Control group’s average li LUTC 
duction was similar to that of the group 
group’s could have been only because "of the 
Whose life production matched that nd the 
LUTC group was purposely selected, = con- 
Control group's average could have rera 
siderably higher than the Control рсе, the 
average, Over a period of time, ee a 
Control group's average would tend e aver- 
back toward the Control population 5 Jete 
age, and by the time LUTC was күс a 
the regression may have been enoug g a- 
significant difference between the group 
erage to appear. ion 

No бана are available on the irre 
averages; hence, the possibility of the " e 
sion Phenomenon cannot be refuted. an 
significant difference in life production i i 
explained by regression toward the emen 
is relevant to ask why the same pheno For 
does not affect auto and fire ар 
both of these, the Control group had "LUTC 
Production very similar to that of the n, ап 
Sroup during the year LUTC Жаз Вау. p 
average production was still quite С e ha 
DIES of fü EUTC gronpsevan astet insurance 
elapsed. Possibly for auto and fire = ction 
the Control Population’s average р e 
WaS never very divergent from the unt 0 
populations average, and no great amo ssibil- 
regression could take place. Another po 0 
ity could be that the rate of ee is 
auto and fire production is slower -— al- 
for life production and more time wou them 
low significant differences to appear for 
also. TC 

What the exact relation between nae 
graduation and performance as an insu basis 
agent is, cannot be ascertained on han 
Of these comparisons alone. eur wit 
LUTC graduation tends to be associate life 
agents who will generate more first-yeat life 
insurance premium and produce larger nore 
insurance policies. If LUTC does no duc 
than help identify agents who will pro hes 
high premium and large Dolicies in the 
ture, it will serve a Worthwhile function. 


PERFORMANCE OF SALES TRAINING GRADUATES 


CONCLUSIONS 


1. LUTC graduates tend to produce more 
first-year life premium than do nongraduates. 
"v LUTC graduates tend to produce larger 

€ policies than do nongraduates. 

" 3. LUTC graduates and nongraduates tend 
9 produce about the same average number of 
ife policies in a year. 

4. LUTC graduates and nongraduates ap- 
Pear to produce life insurance business having 
about the same level of 1-уг. and 2-yr. per- 
Sistency, И 
to 5. LUTC graduates and nongraduates tend 
i dle about the same amount of auto 1n- 

ance and have about the same auto loss 
ratios, 


6. LUTC graduates and nongraduates tend 
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to produce about the same amount of fire in- 
surance and to have similar homeowners loss 


ratios. 
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SCALING ASSUMPTION S UNDERLYING WEIGHTING 


IN JOB-CLASSIFI 


FRANK J. LANDY 


Bowling Green State University 


element dispersions into account. A с 
had the Case V 


perform the job duties satis- 
factorily; (2) Education—amount of formal 
school training; (3) Responsibility for equip- 
ment, tools, product, and materials—job re. 
Sponsibility for preventing damage to equip- 
ment, tools, raw product, or partly finished 


TABLE 1 


SCALE VALUES or Јов Etements 
USING DIFFERENT METHODS 


Job element Case V pa Case TIT 
poene 
Monotony .59 1.18 1.60 
Surroundings 2.45 2.93 3.00 
Hazards 3.12 3.44 2.68 
Pressure 3.60 3.69 3.97 
Education 4.52 4.64 4.61 
Effort — 4.75 4.79 4.96 
Concentration 5.70 5.62 5.48 
Experience 6.64 6.47 6.54 
Resourcefulness 7.71 7.21 6.67 
Responsibility for 
equipment 8.23 7.57 7.07 
Responsibility for 
SUE 7.79 7.62 8.53 
Note.—Scale values transformed to Y — 5, SD — 5, 


AND 


CATION SYSTEMS 


ARTHUR J. ELBERT 


Parsons College 


f 
9r completed products in the реа à 
the job; (4) Responsibility for the w— 
others—responsibility for assisting, ins e 0 
ing, or directing others in the performan d 
their work; (5) Resourcefulness-fndeper, 0 
judgment, making of decisions, or cg not- 
Planning which the job requires; (6) М wot 
ony—sameness or lack of variety of the ony ; 
Which might create a feeling of йл 
Pressure of work. the pace at E: ef- 
the employee must work; (8) Phy: d ef- 
fort—amount and continuity of phys dings 
fort required on the job; (9) Surrouncl a 
—conditions under which the job vp 
performed; (10) Hazards—health and а ) 
dent hazards Connected with the job; tion 
Concentration the degree of concentra or 
required, either to minute job details 
many tasks of the job. r- 
he elements um presented to 29 EUR А 
visors in a Paired-comparison format pu 
ing 55 pairs, They were instructed to C con- 
the element of each pair which they ro- 
Sidered most relevant for overall plant P 
duction, ing Case 
The results were analyzed assuming alues 
V (Guilford, 1954, p. 156). The scale bn 1. 
are presented in the first column of 18 псу 
chi-square test of internal et 
(Mosteller, 1951) yielded a significant У 
(x! = 62.73, p < 05, df = 45), therefore th? 
Scaling was repeated applying а Case III 50 
tion. A test of internal consistency of nt 
Case III solution yielded д nonsignifice 
value (x? = 33.42, p< 30, df= 35). Т 
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j^ 


WEIGHTING IN Jos-CLASSIFICATION SYSTEMS 


scale values are presented in the third column 
: Tabte 1. Estimates of standard deviations 
of е judgments indicated a wide range 
bei Ispersions, the largest standard deviation 
tio ng about five times the smallest. As a func- 
d n of nonagreement on the “Surroundings” 
SER a reversal appeared between the 
Соро of “Surroundings” and “Hazards” in 
А Case ПІ solution. In addition, when the 
$ quality of dispersions was taken into ac- 
pd the reversal between "Responsibility 
i one and Responsibility for the 
tion of others,” found in the Case V solu- 
n, disappeared. 
he results were also analyzed using the 
Omposite-Standard method (Guilford, 1928). 
scale values are presented in the second 
column of Table 1. This method seemed to 
© the least appropriate of the three. Neither 
the two previously mentioned reversals 
Appeared nor was there an opportunity to 
Justify the assumptions of a Case V solu- 
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tion. It was concluded that the Case III solu- 
tion provided scale values most appropriate 
for assigning weights to job elements. 

The most important consideration to take 
into account would seem to be the consequent 
role of the scale values. In the present con- 
text, an inequity in the job-classification sys- 
tem might have resulted if either the Case V 
or Composite-Standard values had been used 
as element weights. 
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COPYING ALPHA AND NUMERIC CODES BY HAND: 
AN EXPERIMENTAL STUDY 


R. CONRAD 


Medical Research Council, A plied Psyc, 


Different groups of housewives Copied alphabetic and n 


of copying. Factors substantially affecting speed or 
accuracy of copying or both are: code length 


under 5 different conditions 


and copied code, whether 


digit codes, grouping of digits, Detailed a 


marked short-term memor; 
similarity between the 
short-term memory studies. 


The increasing use of computers, automatic 
is forcing a revi- 


ope is likely to be- 
come an activity carried out by 


In this simple transaction between a man 
and a complex System, speed of code copying 


into the code so th 
tected with а high 
evitably involved in 
code should have been 
is common, the 


to carry an error risk, lit 


data have been published concerned with 
1 А system used in a number 

for noncash money transacti 

facilities instead of banks. 


of European Countries 
ons using post office 


Present results and those reported fi 


AND A. J. HULL 


hology Research Unit, Cambridge, England 


+ distance between original code 
abetic or numeric, and, for 12- 


1C 
factors relevant to error rates іп alphanumer 
code copying by hand. er- 
Klexis ang Lockhead (1962) seer ie 
Tor data for digit copying by profess iP san 
Punchers, and Braunstein and е rea 
(1959) examined errors when digits pet no 
aloud. Though related, these studies that y 
central to the problem. Neither is иһ the 
Conrad (1962) which is concerned anumeric 
question of whereabout in an ipao un 0 
code to locate numerals when the со refore 
e remembered, The present study к com- 
looks at the problem more directly mer are 
pares error rates and speed when coc vd. 
presented to the "customer" in arid wert 
In varying degrees the following factor со 
investigateq: distance between pact 
and copy, length configurative Eus 8 
within a Code, and whether the code rse 0 
alpha or all numeric But in the ed which 
the study some general results emerge 1 psy 
might illuminate the more fundamen ap ei 
chological processes involved in this 5 


" Я 2. огїап 
widely exercised, and economically imp 
skill. 


МЕтнор 


9 provide 
The basic test procedure was simply о wide 
Ss with a booklet of foolscap sheets (8 1 digit ОГ 
containing one or two columns of кшй, spy the 
letter Sequences, and to instruct ШЕШ а in indi- 
Sequences (codes) as quickly as nese 7 better 
cated spaces. Emphasis was on speed for ful error 
reason than to try to generate more use were fo 
data, and checking was discouraged. Tests V took 
15 min., and all Ss were paid housewives. No very 
Part in more than one test. Test sheets wer! pica 
clearly duplicated from excellent stencils using 
type (letters in upper case), 
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CoryYING ALPHA AND NUMERIC Copes BY HAND 


Tests 


"Pee p were displayed in a single column at the 
е and edge of the sheet with substantial vertical 
eee A dotted line from each code crossed the 
Sheet, and Ss copied each code to the right of a line 
iet vertically 23 in. from the right-hand edge of 
Жин, eet. Codes were 3, 6, 9, or 12 digits in equal 
thre ers but random order. Digits were grouped in 
one S by a space, for example, 496 261 173. Forty- 
5 Were used. 
2. This test was identical to Test 1, except that 
dopo; Were no spaces between digits, for example, 
61173. Forty Ss were used. 
dao were displayed with no spaces between 
ing TE two columns with substantial vertical spic 
numb hey were 3, 6, 9, or 12 digits long in ema 
imm m and random order. The Ss copied each i le 
tine S. У beneath each displayed code. Forty- 
5 were used. ў 
шз test was similar in form to Test 3, that is, 
Ungrouped and copied immediately below. But 
Vor "m Were alphabetic, drawn from the Lyn 
this Шагу: BCFMNPSTVX. The main reason А. y 
ац, Particular vocabulary was used was simply be- 
a Se, having been used in other experiments, pm 
ind Were available on likely intravocabulary, pr 
lett, Sound confusions. All sequences container = 
"a drawn randomly from the vocabulary. Forty 
5 Were used. | 
but y "he same cight-letter sequences used in ehe 
With the format of Test 2, that 1s; ungroupe 
Pied across the sheet. Forty-three Ss were used. — 
ummarizing these conditions for quick reference: 


i Digits grouped far. 
igits ungrouped far. 
igits ungrouped near. 
Letters ungrouped near. 
Letters ungrouped far. 


сл 4 Сә Фә юы 


Тһе $ or speed and ac- 
* Ss' protocols were scored fi gend had no 


independently r h t des 

Ww the purpose of the tests. Scoring discrepa 

ps then checked by Ё. 

sei reliable results minimally 
Тег error or bias. 


RESULTS 
sented relate to five 
ome cases were 
quirement. Be- 


, The results to be pre e 
sec ebendent tests which in 5 
Up to meet a practical re 
A re: 
Cause of certain confoundings, oon 
ehsive intertest comparison 15 point - I 
tests though did use large separate 810 А 
Similar Ss, and where parameters are no ce 
founded performance differences can be 
ully measured 
» ing i five 
Speed and accuracy of copying !n pede 
tests are shown in Table 1. Because 


Varied in length both within and between 
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TABLE 1 


SpEED AND Accuracy Or Copyinc Copes 
UNDER VARIOUS CONDITIONS 


Characters % No. 
Test condition copied per| wrong | wrong 
S/min codes | codes 
1. Digits grouped far 92.7 1.42 108 
2. Digitsungroupedfar | 90.7 | 1.75 | 127 
3. Digits ungrouped near | 101.5 | 1.11 | 90 
4. Letters ungrouped near | 85.3 2.63 185 
5. Lettersungroupedfar | 69.1 | 3.15 | 175 


some tests, the unitary measure of characters 
per $ per minute is used for speed. For ac- 
curacy, the more practically useful criterion 
of whether or not there was an error in the 
code was used, that is, percentage of wrong 
codes. Because where it was varied, code 
length was scrambled within a test, it is not 
possible to present speed data as a function of 
length. But later on, length against accuracy 
is shown. 

Table 2 shows the differences between cer- 
tain tests both for speed and for errors. The 
effect of grouping digits seems to have no 
effect on rate of copying measured over all 
code lengths. If there were a Rate X Length 
interaction it is unfortunately lost in the ex- 
perimental design. Proximity though turns out 
to be important. We can also usefully com- 
pare the copying rates of digits and letters 
according to whether copying is near or far 
(only tests for ungrouped codes are available). 
'These differences are also highly significant. 
It is probable that some of the interactions 
are statistically significant, but because they 


TABLE 2 


DIFFERENCES IN SPEED AND ACCURACY OF 
Copyinc CODES UNDER SPECIFIED 


CONDITIONS 
Conditions compared iin Ашар 
x’ 
Digits grouped versus ungrouped | 1.0 2.59 
Digits near versus digits far 3.05* 24.11** 
Letters near versus letters far 5.06** 3.02 
Digits near versus letters near 5.46** | 74.18** 
Digits far versus letters far 5.68** | 26.68** 
*p <.01. р 
*+p < 001. 
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TABLE 3 
EFFECT or CODE LENGTH ON COPYING ACCURACY 
(70 wrong codes 
Test condition Code length (no. digits) 
ERA ——— 
| 3 6 | 9 | 12 
! | 
1. Digits grouped far 47 | 116 | 126 | 2.79 
2. Digits ungrouped far 33 -99 | 1.49 | 4.19 
3. Digits ungrouped near | .56 -56 | 1.29 | 1.21 


would be in the expected direction, and are 
therefore of little practical value, it has not 
seemed worthwhile to make the statistical 
tests. 

In the case of accuracy, of the five com- 
parisons made, in three of them significant 
Speed differences are associated with signifi- 
cant error differences in the same performance 
direction. Indeed looking at the speed and 


code; the differences for Lengths 3-, 6- and 
9-digits do not reach the 05 significance level. 

Codes were incorrectly Copied by four 
criteria—the only ones to emerge from an 
examination of the raw data: à single char- 
acter substituted, added, or omitted; а pair 
of adjacent characters transposed. Whether or 
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hot in operational conditions a code can tol- 
erate certain types of error more than E 
clearly depends on the particular usage. Table 
4 presents, for each condition, the fo 
of errors falling into the four categories 
transposition, substitution, addition, and omis: 
sion (plus or minus one character; no б 
were found). Once one has taken into accoun 
the small number of errors represented, к 
only striking difference between wp P 
in the number of incomplete codes in Test м 
Furthermore most of these аге due to the 1 i: 
digit code, where it seems likely that Ss y 
ing in chunks lose their place. The wes gm 
this phenomenon is largely associated with a 
digit codes may explain why it does Ne 
markedly occur with the letter codes whi 
all have eight characters. it 
Again discounting small-sample ime 
is evident that most errors are due to im E 
a single character incorrectly. Nevert | be 
the proportion of transposition errors mus in 
far greater than would occur by ed 
fact on every occasion that two adjacent c 
acters were wrong, they were transposed. дя 
The two conditions using letter codes b in 
vided most data, and the location of wer 
the 8-letter sequence was noted. Mte as 
useful sizes of sample, these were T f the 
Occurring in the first or second hal vs 
Code (Locations 1—4 and 5-8). For nghe 7% 
ing the proportions were, г espectively, ificant. 
and 48.3%. This difference is not aT an 
For far copying the values were 42. of the 
57.1%. This difference is significant 
-02 level. i f 
In case in Table 2 the error comp a я 
8-character letter codes with digit n as 
the overall-lengths error score be TEE cance 
dubious, it can be stated that the signi 


TABLE 4 
ANALYSIS or COPYING ERRORS 


% errors 
% N 
RESI. adi 


Test condition : А 
Trans- | Substi-| Plus} М 


position tution | !- = 141 
^ а 5 4 |H 
1. Digits grouped far їл | Got Тоб ES tne 
2. Digits ungrouped far $8 | 32: | е ^u» ios 

- p '8its ungrouped near 15.5 71.7 20 6.1 | 138 
+ -etters ungrouped near 5.0 86.9 6:9 8.0 
* Letters ungrouped far 4.3 80.8 e 


COPYING АРНА AND Numeric СорЕ$ py HAND 


levels are unchanged when letter codes are 
Compared with 9-digit codes, which if any- 
thing would tend to reduce differences. The 
Point does arise, of course, that the unusual 
letter vocabulary used biased the letter codes 
detrimentally. Superficially this is a reasonable 
Comment. But it is not easy to see on closer 
Consideration why it should in fact make a 
difference. In adult Ss all letters of the alpha- 
bet are highly familiar, and the particular 
Subset is within 5% of the mean letter fre- 
Quency of the alphabet as a whole as it occurs 
written or spoken English (Baddeley, Con- 
tad, & Thomson, 1960). Furthermore there 
15 no question that Ss need to remember the 
Ms cabulary— the copied code is always visible. 
К €vertheless it is probable that 10-letter sub- 
RES could be found from which more efficiently 
Copied codes could be derived. From the mag- 
nitude of the presently observed effects, it 
Seems doubtful whether any 10-letter subset 
Would be superior in this situation to digits. 
еп the point does remain open, as does the 
*ct of using other sizes of vocabulary. 


DISCUSSION 


ag more detailed analysis of the kinds of 
s 015 made when copying codes points to а 
“stantial short-term memory component. 
а the fact that there are transposition 
rors at ај] over and above the very few that 
id a Occur by chance, suggests forgetting 
ег than simple failure of mechanical re- 
Production, Second, the significant increase in 
"tors in the second half of letter codes copied 
in is typical of immediate recall data Was 
ea are initially silently read (Conrad, 
;. 65, 1966; Murray, 1966). Although there 
S no internal evidence in the substitution data 
9 point particularly either to copying or to 
Memory as the primary error source, it is 
"key that the evidence for forgetting is 
waved by the effects of “copying” errors. 
ith an error rate of only а few wrong char- 
acters per thousand, an even more detailed er- 
řor analysis was impractical. 
Co his suggestion that even in 
s Dying task memory is importan 
"IDborted elsewhere in the result: 
“ей to make visual shifts of some 


the simplest 
t is indirectly 
s. Once S is 
duration, 
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perceived material must be briefly held in a 
memory store; related to this is the likelihood 
that the greater the distance between the 
original and the copy the less likely would be 
running character-by-character monitoring. 
Thus near-copying is more efficient than far- 
copying, and, in the letter case, the near- 
copying errors are not distributed in the 
sequence like memory errors. Finally the ef- 
fect of grouping is similar to that reported in 
analogous recall situations (Conrad & Hille, 
1957; Thorpe & Rowland, 1965), and so also 
is the digit-letter comparison (Crannel & Par- 
rish, 1957; Mackworth, 1964). 

Two kinds of practical conclusions are sug- 
gested. The first is simply that since ad hoc 
comparisons of different code structures in a 
copying situation are costly of S time and 
laborious, relations between codes may more 
economically be derived from immediate re- 
call tests which will yield far more error data 
per S. 

The second concerns the rules in addition 
to whatever system constraints are necessary 
for designing operational codes which will be 
handled, and particularly copied, by people. 
Clearly, length of code is important especially 
if there is likely to be a distance even merely 
of a few inches between the original and the 
copy. A problem here is that codes are “arti- 
ficially” lengthened by the addition of check 
digits when the codes are part of a computer- 
ized system. Lengthening codes in this way 
permits automatic error detection, but not cor- 
rection. Optimizing is needed as between fewer 
errors but undetected by the system, and 
more errors made but detected and requiring 


correction. Grouping—not unexpectedly— 


helps. . 
Perhaps the most useful rule where it is 


applicable refers to proximity. There seem to 
be substantial advantages to copying a code 
immediately beneath the original. In practical 
terms this becomes a problem of designing 


forms, dockets, etc., in such a way that this 


is possible. 
On the evidence presented here, digit codes 


are preferable to letter codes, a conclusion 
which must be thickly surrounded by qualifi- 
cations. There are many obvious advantages 


for numeric codes in computerized systems, 
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particularly if а decimal vocabulary is a 
priority. Where larger alphabetic vocabularies 
are practicable, utilizing language habits 
(Baddeley, 1964; Underwood & Schulz, 1960) 
could be advantageous in suitable cases. 


One final point here. If code-copying errors 
resemble code- 


of following 


Position effect, then the location in the code 
of particular characters becomes important. 
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COMPARATIVE MANAGERIAL ROLE PERCEPTIONS 
IN MILITARY AND BUSINESS HIERARCHIES 


VANCE Е. MITCHELL ахр LYMAN W. PORTER 


University of California, Berkeley 


This study was concerned with compa: 


tive role requirements perceived 
questionnaire provided data from 
missioned personnel serving in а 
showed that inner-directed traits are 
cess than other-directed, as amo 
the change among 
quirements perceive 
managers. Also, 
for job success eal! 
Results from the noncommissione 


directed behavior. 


differed greatly fr 


ап overseas Air Force Command) experience 
Somewhat greater frustration and dissatisfac- 
‘on in their job assignments than civilian 
managers of equivalent le 

Xt arises as to whether thes 


ate likely to perceive different mM | 
ements in their re- 


vel. The question 
e two groups 
anagerial and 


Administrative role requir 
Spective types of organizations. More spe- 
cifically, do military officers tend to place rela- 
tively greater emphasis on inner-directed be- 
ауіог аза prerequisite for job success when 
Compared to managers in business firms? 


"qually important is the question of whether 
lere are changes in such role perceptions 
Within the military hierarchy (both commis- 
Sioned and noncommissioned officers) that 
Сап be associated with rank, ав is the сазе 
Ог business organizations (Porter & Henry, 


1964), 
Pertinent to the above questions are ше 
] scientists con- 


Speculations of several socia 

cerning the existence of conflicting role те- 
quirements in the modern military organiza- 
tion, For example, Janowitz (1960) notes 
that military hierarchies are commonly viewed 
as 


In a comparative study, Porter and Mitchell 
(1967) have shown that military officers (in 


ng civi 
levels of the militar: 
d differed considera 


commissioned officers’ P 
om those of 


rison of the managerial and administra- 
by military officers and civilian managers. A 
703 commissioned officers and 594 noncom- 
n overseas Air Force Command. The findings 
regarded as more important for job suc- 
Шап managers. However, the pattern of 
у hierarchy and the primary role re- 
bly from those exhibited by civilian 


erceptions of the behavior necessary 
noncommissioned personnel. 


d officers show clear dominance of other- 


rigidly stratified and authoritarian because of the 
necessities of command and the possibilities of war. 
. . . Moreover, because military routines tend to 
become highly standardized, it is assumed that pro- 
motion is in good measure linked to compliance with 
existing procedures [p. 81. 


He advances the hypothesis, however, that 


the organizational revolution which pervades con- 
temporary society and which implies management by 
means of persuasion, explanation and expertise, is 
also to be found in the military [p. 8]. 


Lang (1965) also has argued to this effect 
and cites several studies illustrating the ex- 
istence within military organizations of both 
a variety of leadership patterns and a degree 
of conflict between more permissive, interac- 
tive management and the traditional, hierar- 
chical structure of the organization. The 
present study was designed to provide some 
evidence with respect to these discussions of 
the military as a particular type of social 
organization. 


Метнор 
Questionnaire 


The data for this study were collected by means 
of the same questionnaire, slightly modified for ap- 
plicability to military respondents, which was previ- 
ously used in studies of managers in business firms 
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(Porter & Henry, 1964). The results reported here 
are based on ranki 


investigate a Composite of the Personality attributes 
underlying Riesman’s (1950) Inner-Directed-Other- 
Directed distinction, Why 
the Protestant ethic versus the social ethic, д 
self-descriptions of top managers versus middle man- 


О theoretical 


lysis of the 
results: 


Inner-Directed Cluster Other-Directed Cluster 


Forceful Cooperative 
Imaginative Adaptable 
Independent Cautious 
Self-Confident Agreeable 
Decisive Tactful 


Procedure and Sample 


among commissioned 
with level of man- 


RrsULTS 
Comparisons 


between Military ang Civilian 
Respondents 


managers based on these 
samples (Porter & Mitchell, 1967), the follow- 


ing pairings were Considered as the most ap- 
propriate ones: 


Vance Е. MITCHELL AND Lyman W. PORTER 


Brigadier generals and Vice-pres dents 


Quo MEM 
Lieutenant colonels and $ 
P ager. 
MAJORS Lum Upper-middle manag 
Captains and ers 
H na} 
lieutenants ...... Lower-middle тапав 


the 

The first six columns of Table : e 
mean ranks for each of the 10 traits its for 
total of these for each cluster of “ civil- 
cach of the three levels of military er in 
ian managers, The values in eari S 
Table 1 for each trait have been il larger 
Írom a constant number 10, so vx r per 
numbers ip Table 1 represent greate 
ceived importance, the cluster 

As with the civilian managers, egarde 
Scores show that the military officers га шй 
the inner-directed cluster of traits ganze" 
important the higher the level of the | other- 
tion, while the reverse was true of 1 tionship 
directed cluster. (This reciprocal le are і 
Must, of course, exist since the da а psolute 
terms of relative ranks rather than ase 45° 
ratings.) There is а far stronger incre in th 
Sociated with military rank, apne traits 
importance attached to inner-directe levels 
than was found among corresponding. the 
of civilian management. The d traits 
mean values assigned the uci: un in- 
Y Senior as opposed to junior О between 
creases by 428 while the difference agers і 
corresponding Jevels of civilian manag 
only 1.27, i an- 

Whereas all three groups of bustien acted 
agers clearly perceived the eni nom the 
group of traits as more important | group 
other-directeq traits, the онна талаша as" 
of officers, the captains and Пешеп other- 
signed a slightly higher total to t the lieu 
directed cluster, Moreover, although ipner-di- 
tenant colonels and majors valued directe , 
Tected traits more highly than other- ү 
their tota] for the inner-directed clus rparts 
notably lower than that of their pos most 
the upper-middle business managers. Is ап 
Senior military, the brigadier gener irecte 
colonels, however, ranked the anner com- 
cluster somewhat higher than did Ше eket 
parison group of vice-presidents, their 34 as- 
total being 26.50 as compared with 25. 
signed by the vice-presidents. 
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In terms of the 10 individual traits, both 
samples show specific trait trends generally 
Consistent with the overall cluster trends, al- 
though there are several interesting differences. 
The trend for Seli-Confident in the inner-di- 
Tected cluster is weak for civilian managers, 
and it is actually reversed for the military. 
That is, officers see Self-Confident as rela- 
tively less important to success with increas- 
ing rank. Tactful, in the other-directed cluster, 
15 seen by officers as having increasing im- 
Portance with higher rank, a perception di- 
rectly opposite to that of the civilian man- 
ügers, 

One of the most interesting findings is the 
Comparative ranking of Imaginative. Business 
and industrial managers consistently ranked 
this first in importance among the 10 рег- 
Sonality traits, For the military, it assumed 
аг less importance, being ranked sixth by 

oth the junior and middle groups of officers 
and only fifth by the brigadier generals and 
Colonels, Instead, Decisive assumed primary 
™portance for the top- and middle-ranking 
Military groups, while Self-Confident was 
ranked first by the captains and lieutenants. 

is latter group also attached great im- 
Portance to Adaptable, ranking it second in 
Overall importance. All other groups, military 
and civilian, perceived this trait as of far 
ess importance. 
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Comparisons within the Military H ierarchy 


Table 1 also presents results from the entire 
military sample and permits comparisons of 
the officers’ rankings with those of the non- 
commissioned respondents. 

The cluster totals for the inner-directed 
traits exhibit a continuous trend of in- 
crease in importance with higher rank 
throughout the military hierarchy. Thus, 
whereas commissioned officers, at least those 
in higher grades, strongly favor the inner- 
directed over other-directed traits, this prefer- 
ence is distinctly reversed for noncommis- 
sioned officers. 

With respect to individual traits, all non- 
commissioned officers rank Selí-Confident as 
the most important of the 10 personality 
traits for job success. Tactful is ranked second 
most important by the top- and middle-grade 
groups of noncommissioned officers and third 
by the staff sergeants. Interestingly, the im- 
portance of this trait increases within each of 
the two officer hierarchies, with the highest 
noncommissioned officer group placing more 
emphasis on it than any of the other five 
groups. Decisive, ranked as most important by 
the top and middle commissioned groups, 
drops to third for chief and senior master 
sergeants and to fifth for the other noncom- 


missioned respondents. 


TABLE 1 


MEAN IMPORTAN 
Атк FORCE OFFICERS VER 


CE (10-Х RANK) оғ TRAITS FOR Јов Success: 
sus CIVILIAN MANAGERS 


Noncommissioned officers 
Lower- 
Lt./Col./ pper- | Cpt/Lt. | Middle 
, v. Pres. | “Мај.” | Middle, | (V —460)| у = CMS/ 
Trait B.G./Col | (V £601) | (ү = a17)| (N = 650) (N = 428) MS/TS ss 
(N = 22) | (N (у (MS) 107 = 302) |07 = 213) 
Inner. Di 
7 4 3.88 3.82 2.95 2.88 2.52 
Forces ected 4.62 4.02 А 2 Я 
ul 5.73 4.19 6.13 4.74 6.41 4.20 3.97 3.77 
Magi: E 4.89 А 4 85 r4 
[maginative zn | 85 | te | 2 | iB | ou | so ois | Ww 
S. | Me | fe | ate ш ЕТЕ ТЕЗЕ ЗЕ 
Total for cluster 2650 25.34 23.32 24.61 22. 4 : 20.66 19.86 
Other-pi 7 5 5 
-Directed 5.61 5.70 88 5.90 6.09 6.41 
‘operative 5.09 5.49 569 5.13 5.81 5.16 4.88 5.37 5.48 
aptable 4:32 4.77 1:85 1.30 244 124 2.92 321 3.45 
autious 1.18 1:38 P 2:84 eat 291 3.35 3.55 3.74 
greeable 2.00 261 5:64 5.52 a aus 6.47 6.11 6.04 
‘Total for cluster 1803 19.67 21.69 20.40 : : 23.52 24.33 25.12 
е pbreviations: B,G./Col. = Brigadier General/Colonel group: V. Pres. 
Note.—Higher numbers indicate greater importance; / Major group: Cpt./Lt. Captain/Lieutenant group. CMS/SMS 
TS = Master Sergeant/Technical Sergeant group; SS = Staff 


= Vice-President; Lt./Col./Maj. = Lieutenant/Colone! 


Sergeant group. 


MS/ 


Discussion 


Somewhat more even blend of inner- 
other-directed behavior than seems 


standable. The Officer as 
"command-decisions » 


Vance Е. MITCHELL Ар Lyman W. PORTER 


ance evaluation (Janowitz, 1960; Lang, mn 
The relatively low ranking of Imagan e 
more difficult to explain. For some yeà tedly 
top leadership of the Air Force has ae 
called for innovative and imaginative H 
agement by members of the officer о re- 

The results from the поперттБз nts 
spondents show the clear dominance of a 
directed behavior at these levels in eei this 
tary hierarchy, Since the emphasis a eac 
type of behavior decreases steadily military 
higher leve] surveyed in the overall S хеси- 
hierarchy, as was true among business ether 
tives, it is interesting to speculate W an 
lower levels of supervision in ps im- 
business would attach the same ые i 
portance to other-directedness as do t st be 
Force noncommissioned officers. It commis- 
pointed out, of course, that the pus fo 
sioned supervisors in the sample obtain сира“ 
this study were individuals whose ле ad- 
tional concern by definition is limiten siye 
ministrative ог logistical matters. leaders; 
of the perceptions of enlisted combat mig 
as in Infantry or Special Forces units, 
yield quite different results. 

1 As, for example, in an address by (then) Secr! 


а! 
Air W* 
of the Air Force Eugene M. Zuckert to the unc 


n 
College, Maxwell Air Force Base, Alabama, 0 
4, 1965, 


etary 
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A PROJECTIVE STUDY OF ATTITUDES TOWARD 
CONTINUING EDUCATION 


IRWIN M. RUBIN ахо HOMER G. MORGAN? 


Alfred P. Sloan School of Management, 


A projective instrument aimed at m 
education described a hypothetical re 
MS degree in a 
(c) completed onl 
given to 312 en 
esearch and development engineers did not 
‘erence between obtaining a degree or taking several 


having (a) obtained an 
completed 7 courses, ог 
The 3 versions were randomly 
and development center. R 
perceive any significant diff 
courses in a continuing е 
taking several courses wer 


ducation program. However, 


e both seen as having mori 
ved as being associated with more manage- 


Massachusetts Institute of Technology 


easuring attitudes toward continuing 
earch and development engineer as 


continuing education program, (b) 
ly 1 course since receiving his BS. 
gineers in a government research 


obtaining a degree or 
e positive attributes than 


taking only 1 course, were регсеї 2 . : 
and greater professionalism, and as keeping 


ment potential, higher ambition, 
an engineer more up to date. 


Continuing education and technical ob- 
Solescence of engineers have been subjects of 
much discussion. Numerous reports have been 
Written and many conferences have been held. 

l of the studies on technical obsolescence 
Conclude that technical learning is necessary 

TOughout the lifetime of an engineer.” They 

. Süggest that the current pace of technology 
j Tequires that informal, on-the-job type of 
earning must be supplemented by more 

Ormal continuing educational opportunities. 

hese opportunities can take many forms, as 
Pointed out in a recent study by the Staff of 
e Industrial Research Institute (1965), 
ranging from attendance at technical meetings 
and seminars, through participation їп com- 
Pany-sponsored classes, to leave for study as 
resident graduate students. However, the con- 
P of most of the available literat 
md by Foecke (1966) 
еп he said: 
Perceptive nor snobbish to say 
Oof literature on continuing e 


that the body 
ducation for 


. ‘The data reported in this paper were алей 
n conjunction with an unpublished master's ter 
Y Morgan (1967). The work was done in р T. 

* Massachusetts Institute of Technology (M. L1. 


9mputation Center. 
th Presently with the Langle 
€ National Aeronautics and Space А 
(NASA), 
he 3s for example, кыно Society for 
ucation (1964); Engineers с 
essional ea ner (1966); National Society of 
rofessional Engineers (1965); Torda (1963). 


y Research Center of 
$ dministration 


r Engineer- 


engineers is not characterized by a wealth of 
penetrating discussion [p. 881]." 

With few exceptions, little empirical re- 
search, as opposed to “armchair philosophiz- 
ing," has been conducted in this area. Cenko 
(1964) collected questionnaire data from 
engineers and engineering supervisors in three 
large research and development corporations 
which indicated that, as expected, obsolescence 
increased the longer a person was out of 
school? He also found that engineers who 
completed at least two advanced engineering 
courses in a 4-yr. period were perceived as 
having obsolesced less than engineers who 
did not take courses. Another result of his 
investigation was that engineers with above- 
average mathematical ability, first, are more 
likely to pursue and complete advanced engi- 
neering courses, and, second, have a better 
opportunity for improving or maintaining their 
technical skills than other engineers. This 
work has substantiated the assumption of 
most authors that continuing education (in 
this case, advanced engineering courses) is a 
valid technique for combating technical ob- 
solescence. Engineers themselves regard tech- 
nical courses as important or very important 
to their professional development, as over 
8096 reported in one survey (Anonymous, 

i This study defined an “obsolescence index" as 
the accumulated scores on a series of questions an- 
swered on a 7-point scale. A weighted average of an 


engineer's responses and his supervisor's ratings gave 
the final index. 
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1964). Still another study by Warkov and 
Marsh (1965) revealed that recipients of any 
kind of supplementary training were in a 
minority in 1962. Only 41% of the engineers 
they surveyed had participated in any kind 
of continuing education. They also found 
that supplementary training was an inverse 
function of formal educational attainment— 
the higher the degree, the less likelihood of 
having participated in supplementary training. 

These few empirical studies discussed above 
have suggested that continuing education is 
highly desirable for engineers and that engi- 
neers themselves recognize the desirability. 
Still, only a minority of such personnel have 
actually Participated in any supplementary 
training. However, the problem of motivating 
the individual to continue his education has 
previously been recognized. For example, 


а recent conference (Torda, 1963) pointed 
out: 


and economic rewards as well as recognition of 
the importance of engineers and their performance 


seem to be equally vita] in achieving this goal 
[p. 3]. 


Since it has been Suggested that continuing 
education is beneficial in alleviating technical] 
obsolescence, but that participation is mainly 
a function of the individual’s attitude, this 
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METHOD 
Measurement Instrument 


The nature of the phenomenon under DVN 
tion—attitudes toward continuing edu Ee 
the sophisticated level of the relevant рер end 
tion—engineers and scientists—led us to the S ctia 
ment of a projective-test instrument. TA S (gif) 
method has been described by Mason Haire е 
in his classic paper on application of pro) 
techniques to market research as: 


оне 
Basically, а projective test involves puentes, a 
subject with an ambiguous Lopes qr him 
does not quite make sense in itself—and as rder to 
to make sense of it. The theory is that ‘fil out the 
make sense he will have to add to it—to fi of him- 
Picture—and in so doing he projects part in the 
Self into it. Since we know what gd шу the 
original stimulus we can quite easily iden inlessly 
Parts that were added, and, in this way, pe à 
obtain information about the person [p. 


seful 
Projective methods, in other words, ae dis- 
whenever people are unwilling or unable metho 
Cuss their true attitudes, The projective-test himsel 
makes it easier for the person to MEA own 
Since he is not talking explicitly about able {0 
attitudes and feelings. He may also be accurately 
describe his own feelings and attitudes as m situa- 
as they can be discerned in the projective-tes "y 
tion. This method was thought to be par desire 
applicable to the present study since it was subject 
to obtain the attitudes of engineers toward * ecte 
(continuing education) which intimately 
them and their associates, form of а 
The final projective instrument took the fo 5 


incer; 
Tesumé of a research and development eng! 
as follows: 


—" iring 
The personne] department is considering b 
an engineer to assist you in your proje ote 
following resumé has been received from а his suit- 
new employee and you are to evaluate ofully- 
ability as your assistant. Please read it car 


RESUME 


ntial 


Vital Statistics: 
Name: John Doe 
Date of Birth: June 4, 1936 
Height: 57117 Weight: 175 lbs. 
Marital Status: 
Married, two children 
Military Service: 
I 
None ook the 
Doe, а) 


rc 
Resea 
any 


> Ап earlier version of this instrument t 
form of single-paragraph descriptions of Joe 
aerospace engineer working in a NASA htm 
Center. The results of a pretest brought to lig! este 
Problems. The idea of using a resumé was eee E 
by a colleague at M.LT. Tom Allen, The va iti 
a pretest will never be more clear to us since 7 ей 
doubtful if usable data would have been obtain 
with the original version of the test instrument. 


| 
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Education: 
B.S. in Aerospace Engineering, University of 
Michigan, 1958 
M.S.9 in Aerospace Engineering, Case In- 
stitute of Technology, 1962 (obtained through 
company sponsored graduate training program) 
Health: 
Good 
Professional Experience: 
NASA Lewis Research Center, 
Ohio, 1958 to present 
Research and Development projects 
Experimental equipment design 
Data analysis and processing 
Supervised laboratory technicians 


In order to allow the subject to project himself into 
€ resumé, the fictitious engineer was presented as 
anig Worked at the NASA Lewis Research Center, 
whe is a sister installation of the NASA center 
is the data were collected. The educational 
sel ground was made both neutral and realistic by 
electing а good but not top engineering school for 
"s Alma mater and using a good technical school 
Ed the Lewis Research Center for his continuing 
“cation (Walsh, 1966). 
ы; Projective stimulus was Р 
: ual Without an explanation 
серца Structions said it was à S 
asked thee research and development 
asked p е participant to assume 
iwi a роса, FEN, pe 
impli i г; 1 X У 
ay employee po ie hired as the participant's 
шаш. No mention of continuin 
Staduate extension courses Was made except 
* cues listed under the educational qualifications 


Of the resumé | 
he respondent was asked to make his a ene 

У tating the engincer described in the resumo. ін 
dus of bipolar adjective pairs. The majori E 
ese adjective pairs were adopted from р ks 
isearch by Schein (1965) in his studies of stu cp 
аде of their professors. The items were шен i 
^D Such factors as activity, competence; ms eo 
"id individualism. Several pairs, such 25. ‘obso M d 
date," were added because 0 their par ш 
relevance to the present study. Several control ite " 
Such as “warm-cold” whose scoring should но 
‘fluenced by attitudes toward continuing education, 


Were als 
о added. P i rere 
зе], фота, total of 43 se pairs, 17 fs thought 
ected 7 i ose percep! 
—Stted 7 for analysis whose p 


"This i ums” version. The S 
Version au nap os courses 1M De d 
ÜhSineering, Case Institute of Technology, Amate 
965.” The “one-course” version read: “1 з m 
extension course in aerospace engineering, Cas? 
Stitute of Technology, 1959." 

"'The initial plan was to factor 2 
Adjective pairs. This process failed to ге 
clear-cut factors. The experimental items were S! 
rior to any further data analysis. 


Cleveland, 


resented to an mM- 
of its true intent. 
tudy of the per- 
t engineers and 


ttgeyen-course" 


nalyze the 43 
veal any 
elected 


to be most dependent upon the version of the 
projective stimulus seen. The selected items were 
ambitious-unambitious, high initiative-low initiative, 
intelligent-nonintelligent, management potential-not 
management potential, professional-unprofessional, 
scientific-unscientific, active-passive, growing-station- 
ary, up to date-obsolete, clear thinking-muddled 
thinking, enthusiastic-unenthusiastic, and aggressive- 
timid. In addition, as a control, three adjective pairs 
(tolerant-prejudiced, warm-cold, and poised-awk- 
ward) were included for analysis. The analysis of 
these three items, which should ло? be perceived 
differently due to exposure to the three stimuli, was 
expected to add confidence to any results obtained. 
For discussion purposes, the polarity of some of the 
adjective pairs has been reversed from their polarity 
on the test instrument in order to make the more 
“desirable” or “positive” state appear оп the left 
ole. 

P These adjective pairs would enable us to test 
the general hypothesis that the engineers described 
by the “М5” and "seven-course" stimuli would be 
seen in a more positive light than their counterparts 
in the “one-course” condition. 


The Study Group 


The study group was selected from the research 
and development engineers at the Langley Research 
Center of the National Aeronautics and Space Ad- 
ministration. Langley has about 4,300 employees, of 
whom approximately 1,500 are engineering and 
scientific professionals. Most of the professionals are 
assigned to 10 major research divisions which are 
organizationally separate from groups responsible 
for administration and technical support functions. 
The personnel surveyed in the present study con- 
sisted of all professionals classified as aerospace 
technologists, excluding supervisors, in 4 of the 10 
research divisions.$ 

An interview with a member of the Training Office 
staff at Langley indicated the pervasiveness of the 
continuing education program. Each year, about one- 


8 The participating groups have an extensive con- 
tinuing education program available to them. Since 
Langley is a government center, its educational 
programs are based on Public Law 85-507, the 
Government Employees Training Act of 1958, which 
established a policy of encouragement and support 
for continuing education of government employees. 
Langley implements the policy by offering extension 
courses in technical subjects, sponsored by one of 
three nearby universities, during duty hours with all 
fees for qualified employees paid by the government. 
Professional employees who have been accepted for 
graduate study and have successfully completed two 
extension courses are also eligible for graduate-study 
leave for full-time resident study, whenever such 
study will upgrade their capabilities. While оп 
graduate-study leave, an employee's salary and 
tuition fees are paid by the government. Resident 
study such as this usually leads to a graduate degree 
with the thesis research carried out in conjunction 
with a Langley project. 
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third of the professional Staff is active in the pro- 
gram. It is estimated that 90% of the research pro- 
fessionals have Participated at one time or another, 
and this year (1967) employees are studying at 
27 different institutions. In the last 15 yr, 257 
master's degrees and 28 doctoral degrees were earned 
from 33 institutions. In terms of demographic char- 
acteristics, the average age of the group was 33.9 
Yr, with extreme values of 22 and 63 yr. The 
average experience level was 9.8 yr. while the average 
length of agency service was 9.2 yr, With respect to 
education, 2% had doctorates, 25% had master's 
degrees, and 73% had bachelor's degrees. Fourteen 
Percent considered themselves to be in analytical 
Work, 31% were engaged in experimental] Work, and 
55% performed a combination of analytical and 
experimental work, 

Participation in their agency's continuing educa- 
tion program was quite varied among the group 
surveyed. Thirty-three Percent had been on graduate- 
study leave at some time in their 
they had been away from their job: 


Data-Collection Procedures 


The four research divisions 
as being representative of th 


ate number of 
of personnel assigned to the four 


em- 
on graduate-study 
est instrument were 
by alternating the 


nel list arranged j - 
betical order. Se^ AS айа 


€ Seven-course 

e one-course Version, Only 

9'The success of this process Was checked and it 
was found that each of the i 


Perience, years with 
number of Previous 
Participation in the 


NASA, type of work performed, 
courses taken, and degree of 
Graduate Training Program, 
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П s r nusable. 
5 responses were received which эе. o etudy? 
Anonymity was maintained throughout 


RESULTS 


e 
The original hypotheses stated that О 
engineer described in the MS eee than 
be seen as having more positive tral sons 
either his seven-course or one-course aei in 
parts. In addition, the engineer € seen 
the seven-course condition would же 
more positively than his one-course e engi- 
part. Finally, these three i come the 
neers would be seen as no different Id, ап 
traits of tolerant-prejudiced, warm-cold, 
poised-awkward. 2, 
The results are presented in To їп 
and 3 and are summarized RU 0 
Figure 1. The tables contain gH they 
information about the groups ie the 
compare. First, the median scores he lowe! 
ratings of each group are presented (t Next, 
the score, the more positive the rating), each 
the tables contain the percentage à roup 
group which scored above the на ne Siffer- 
median. Finally, the significance of t ps from 
ence between the medians, as determine 
a Mann-Whitney U test, is provided. drawn 
The first conclusion which can be sample 
from these data is that, within the ie 
studied, no differences exist between ble 
and seven-course conditions. (See L5 seen 
Person receiving a master’s a ate, 
as no more ambitious, intelligent, uP leted 
etc., than an engineer who has — our 
Seven advanced courses. The first. 0 
hypotheses js therefore unsubstantiated. ер 
With respect to the other two hyp = an 
the results are remarkably consisten items; 
clear. On each of the 12 experimental ' an 
With a very few exceptions, the М5 gro ively 
Seven-course group are seen more pos (5 
than their one-course counterparts. ices 
1° Since the test instrument is a projective d% of 
its success in disguising the intent of the aA he 
interest, Several notes were included на test 
returned questionnaires which indicated mus the 
instrument was sufficiently ambiguous. Perhé 
most informative feedback came from one np 
Serious participant who telephoned to СОП su 
about the request for an evaluation based ore the 
flimsy data. He ended with the advice tha ould 
resumé was so vague that the questionnaires W 


ч em 
actually reveal more about the people filling th 
out than about the engineer being evaluated! 


very 
Jain 
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TABLE 1 


COMPARISON or MEDIAN RESPONSES TO ADJECTIVE PAIRS FOR MS-DecREE VERSUS SEVEN-COURSE CONDITIONS 


Percentage above 


Mdn н 
group median 
Adjective pai ең a 
djective pair MS-degree Seven: — СИР Р 
group course A -degree course 
О 
(N = 106) w. M group group 

Ambitious-unambitious* 3.00 3.30 53.8 46.1 .23379 
High initiative-low initiative 3.52 3.69 532 46.6 14279 
quelligent-nonintelligent. 3.39 3.67 54.9 44.9 .06901 
Management potential-not management 

ore 3.48 3.82 55.5 дз | .07374 
РИЕТИ 3.07 3.33 54.1 45.7 09475 
Б жад шы 2.81 2.92 52.4 47.6 15528: 
Clive-passive 3.41 3.35 49.2 50.8 .34890 
Growing-stationary 3.46 3.49 50.4 49.5 133720 
р to date-obsolete $57 3.50 48.8 31 2 39946 
Clear thinking-muddled thinking pis р FE UE 93001 
Enthusiast; pe 3.84 3.74 48.7 51.3 „35125 

usiastic-unenthusiastic 5 s 

Aggressive-timid 3.88 4.03 52.6 47.4 135195 
olerant-prejudiced 4.14 4.20 51.5 48.4 33558 
Warm-cold | 4.37 4.36 49.7 50.3 43642 
ша жасым 169 4.75 48.4 517 127520 


edians, one-tailed, 


mi m 
гелсе of bitious relative to the seven-course group. 


» Mann-Whitney U test on шеге neam 


The MS-degree group is seen а: 


TABLE 2 


pONSES TO ADJECTIVE PAIRS FOR MS-Decree Versus ONE-COURSE CONDITIONS 


Comparison or МертАх RES 


Man Percentage above 
group median 
. H a d 
;e pair Ў 
Adjective ра ие азада MS-degree | One-course 

qv — 106) | W = 94) group group 
AMbitious-unambitious? Hp hd en и бу 
ligh initiative-low initiative 3.39 418 62.0 37.1 00022 
elligent-nonintelligent i 7 
мету management potential 22 Fes Фу E ped 
E'ofessional-unprofessional 2.81 3.29 58.6 40.8 101530 
паис натина 3.41 3.93 56.6 42.8 .01843 
tive-passve 3.46 3.97 58.4 40.9 00086 
Up to date-obsolete S |р Be | me | 
Clear thinking-muddled thinking 3.84 4.25 $56 РН 100955 
Enthusiastic-unenthusiastic 3.88 4.11 53.8 45.8 "20851 
ggressive-timid 4.14 4.20 51.6 48.3 30300 
Do poe 4.37 4.39 50.4 49.5 .44490 
noel 4.69 4.66 51.5 48.4 132712 


Poised-awkward 


В ians, one-tailed. 
? Mann-Whitney U ten OS difference of нош relative to the one-course group. 
is seen а: 


b'The MS-degree group 
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ТАВГЕ 3 
COMPARISON OF MEDIAN RESPONSES ТО AD JECTIVE Pairs FOR SEVEN-COURSE VERSUS OxE-CounsE CONDITIONS 
мап Percentage above 
group median 
Adjective pair evi ” 

5еуеп- One-course | Seven- 

course group course One-course 

grou 3 u 

Pi 5» (N = 94) | group Bren 
a 
Ambitious-unambitious 3.30 5 WE 
mbitious-u 4.08 Т 38.5 ‘ 
High initiative-low initiative 3.69 4.34 A ; 38.6 00177 
Intelligent-nonintelligent 3.67 d 18 58.4 41 А 00834 
Management potential-not management potential] 3.82 4.08 53.6 46.2 05466 
Professional-unprofessional 3.33 3.54 53.8 46.1 13858 
Scientific-unscientific 2.92 3.29 55.9 43.9 13241 
Active-passive 3.35 3.93 57.9 418 00519 
Growing-stationary 3.49 3.97 pia 41.6 00376 
Up to date-obsolete 3.50 425 ue 36.1 00011 
Clear thinking-muddled thinking 3.70 4.12 p 5 ш 
Enthusiastic-unenthusiastic 3.74 4.25 25 21 00250 
Aggressive-timid 4.03 ATI 259 s 33703 
Fe prejudiced 4.20 4.20 Fe 49.9 4161 
arm-co à j : ji 
arm-cold 4.36 à 5 49625 
Poised-awkward 4.75 тр 2 оз 18286 
* Mann-Whitney U test on diffe f i i 
> The seven-course group is seen as more ашырар aed: the one-course group, 
AB 
ITIOUS UNAMBITIOUS 


HIGH INITIATIVE 
INTELLIGENT 
MANAGEMENT POTENTIAL 
PROFESSIONAL 
SCIENTIFIC 
ACTIVE 

GROWING 

UP TO DATE 
CLEAR THINKING 
ENTHUSIASTIC 
AGGRESSIVE 
TCTERANT 

WARM 


POISED 


M ы a‘ o „ёт 
2 
5 һ т 


SEMANTIC DIFFERENTIAL SCALE 


Fic. 1. Median Score profiles. 


LOW INITIATIVE 
NONINTELLIGENT 

NOT MANAGEMENT POTENTIAL 
UNPROFESSIONAL 
UNSCIENTIFIC 

PASSIVE 


STATIONARY 


UNENTHUSIASTIC 
TIMID 
PREJUDICED 


COLD 


ATTITUDES TOWARD CONTINUING ÉDUCATION 


Tables 2 and 3.) Furthermore, as hy- 
pothesized, no differences are observed on the 
three adjective pairs which were included as 
Controls. The exception is most consistent 
With respect to aggressive-timid. In the other 
Cases where the differences do not reach 
Statistical significance (Table 2, clear think- 
Ing-muddled thinking, and Table 3, scientific 
and active), the difference is in the predicted 
direction. 

These results are all the more striking when 
Опе considers one other factor. It will be re- 
called that data were collected on 43 adjective 
Pairs. The 15 items used for hypothesis testing 
Were selected prior to any data analyses. 

fter testing the hypotheses, the responses to 
24 of the remaining adjective pairs across 
the three experimental conditions were com- 
Pared. Of these 72 pair-wise comparisons (24 
items across 3 groups compared 2 at a time), 
4 reach statistical significance. This is almost 
the exact number of significant differences 
(3.6 or 72 x 0.05) one would expect to find 

Y chance alone! 


DISCUSSION 


. Within the sample of engineers studied, it 


is clear that certain very strong opinions are 
eld with respect to continuing education. 
A closer look at the adjective pairs gives an 
idea about specific attitudes. If the "pee 
and seven-course groups are lumped toge € 
for the moment, as the continuing-educa шен 
Stroup, Figure 1 shows that рай рала ч 
Continuing education is perceived > d d as 
an engineer less obsolete. He !5 A: P ore 
clearer-thinking, growing, асру, an gem 
Up-to-date. Continuing education is also pe 
Ceived as a mark of professionalism. 7 ue 
ticipating engineer is seen a5 more inte Е rà 
Professional, and scientific йш : ate 
ticipating engineer. A participating tion 
15 also regarded as having re es hi her 
higher initiative, more enthusiasm, tici iur 
management potential than а nonpartcipa Pe 
engineer. 
Contrary to 


Nificant differences were 
iti ay be 
MS and seven-course conditions. It may 


É А even- 
that the engineer described in the з se 
course condition was seen as working to 


i no sig- 
initial expectations 
а found between the 
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but not having yet received an advanced 
degree. On the other hand, the actual degree 
may be less important than the steps necessary 
to get the degree, that is, taking many courses. 
One way to examine this issue is to widen the 
gap between two such hypothetical engineers. 
In other words, how will peoples’ perceptions 
of an engineer who has earned an MS degree 
8 yr. ago and taken no courses since then 
differ from an engineer who has taken one 
course per year since receiving his BS but 
has not received an advanced degree. 

It is recognized that many factors can be 
expected to influence the attitudes of research 
and development engineers toward continuing 
education. Within the design utilized in this 
study, the variable effects of such factors as 
age, experience, and educational level were 
eliminated through randomization. Further re- 
search could fruitfully focus on the relation- 
ship between individual characteristics and 
attitudes toward continuing education. 

The fact that our results strongly suggest 
that engineers perceive continuing education 
as contributing to managerial advancement 
raises interesting questions about the reward 
structure in an organization. The issue re- 
volves around the dual-ladder concept of 
movement through an organization's hier- 
archy. To what extent does an organization 
want its engineers to view continued technical 
education as a path to promotion into the 
managerial hierarchy? It is conceivable that 
some engineers might not bother with con- 
tinuing education because the reward of be- 
coming a manager is not what they desire. 
Many have a desire to continue in their tech- 
nical specialties, and it is to the organization's 
benefit to make certain these people are 
rewarded in a manner consistent with their 
interests. 

The organization we have studied is one in 
which continuing education is heavily en- 
dorsed, as evidenced by the opportunities 
made available to people and the number of 
people who take advantage of these op- 
portunities. It would be very interesting to 
study the relationship between the climate in 
an organization with respect to continuing 
education and individual attitudes. In what 
ways, if any, would peoples’ attitudes have 
been different if we had studied an organiza- 
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tion which provided very few opportunities 
for continuing education. 


Finally, we are very much encouraged by 
these initial results achieved through the 
utilization of a short, inexpensive, easy-to- 
administer, projective instrument. The effects 
of many different stimuli can be investigated 
within the framework of the method we used. 
With very few changes, one could study at- 
titudes toward short courses versus graduate- 
level courses, in-house versus on-campus 
courses, management subjects versus technical 
subjects, and a variety of other important 
issues related to the question of technical 
obsolescence and the role of continuing 
education. 
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RVIEW DECISIONS: 
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Life Insurance Agency Manageme: 


Previous research by the autho 


serving as interviewers repor 
basis of appearance. In addition, 
managers report they will make emp! 
written summaries of an applican 
vestigated the г 
interviewer's fina 
It was the purpos! 
pearance and written infor 
contrasting patterns. It was foun 
on the final rating. 
written information were pre 
a component in the final rating 
that contributed by the separat 


information. 


it 


due t 
er 


Recent studies of the selection interview 
ave concentrated on the decision-making 
Process and the variables which influence it. 
From such a study, Springbett (1953) con- 
Cluded that the interview is primarily a search 
for negative information. A later study by 
Bolster and Springbett (1961) confirmed this 
finding and, in addition, concluded that the 
interviewers most ready to commit themselves 
to a decision were the quickest to return toa 
Noncommittal position when information of op- 
Posite value was presented. More recent stud- 
les have presented additional evidence that 
Negative information is given more weight in 
the final decision than is positive information 
(Mayfield, 1964; Mayfield & Carlson, 1966). 
"These and other studies (Webster, 1964) 
àve indicated that future research on the 
ecision-making process involved in the selec- 
tion interview will become more complex. For 
example, the studies noted earlier varied the 
favorableness of the information presented to 
Various interviewers. Yet Mayfield and Carl- 
Son (1966) have since shown that properties 
Other than the favorableness of the specific 
items of information about an applicant might 
€ related to the outcome and the reliability 
Of the final decision. In а 


ddition to favor- 


t they will make 


t. However, prev 
elative effect of appe 


d that the appearance 


It was also found 
sented in a complemen 


nt Association, Hartford, Connecticut 


r has shown that life insurance agency managers 


employment decisions on the 
has also been shown that these same 


loyment decisions on the basis of factual 


ious research has not in- 
e vs. factual written data on an 
oí life insurance agent. 
. The ap- 


aranci 


that when the appearance data and 
tary manner there existed 
o information favorableness greater than 
atings of the appearance and written 


ability, these properties were: (1) the inter- 
rater agreement on the items of information 
and (2) the intrarater agreement of the items. 

Another information property which has 
been shown to have a differential effect on the 
outcome of simulated interviews is the ob- 
jectivity of the information presented to inter- 
viewers (Carlson, 1967a). For example, in 
previous studies the author has found that in 
the absence of other information, life in- 
surance agency managers acting as inter- 
viewers reported they would offer an average 
of 1.83 employment contracts for a sample of 
eight applicants on the basis of appearance 
alone (Carlson, 1967a; Carlson & May- 
field, 1967). In the same studies using a 
second sample of managers as interviewers, 
they reported they would make an average 
of 2.60 selection decisions on the basis of 
written information alone. The mean differ- 
ence between the number of applicants re- 
portedly hired from photographs and the 
number hired from written information was 
statistically significant at the .01 probability 
level. The implication was that managers were 
more influenced by the objective written in- 
iormation than they were by the more sub- 
jective appearance data. However, the design 
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of the previous study did not allow a relative 
comparison between the reported use of ap- 
pearance data and the use of written informa- 
tion. It is the purpose of this study to allow 
interviewers to use both appearance data and 
written information and to examine the rela- 
tive effect of each on the final evaluation of 
the applicant, while controlling on the favor- 
ability, inter-, and intrarater agreement of 
both types of input information. No a priori 
hypotheses were advanced as to the relative 
strength of appearance versus written informa- 
tion or the effect of the various information 
Properties on the final interviewer ratings. 


МЕтнор 
Subjects 


agers, г ha responsibility for recruit- 
Ing, interviewing, selecting, and training salesmen to 
work under their supervision. 


Construction о / Hypothetical A bplicants 


j Using а paper-and-pencil approach, lists of 125 
information selecti 


‘anagers attending 2-wk. 
Schools. The reasons for the Paper-and-pencil ap- 


of constructing the in. 
lion have been described 
yfield & Carlson, 1966). 


TABLE 1 
IDENTIFICATION OF HYPOTHETICAL 
TERMS or PSYCHOMET: 
FORMATION USED т 


APPLICANTS IN 
RIC PROPERTIES ОЕ In- 
© Construct THEM 


Measure 
Hypo- 
thetical 
applicant | Favor- Interrater | Interrater 
ableness | agree agreement 
Breiten (stability) 
1 High High Low 
1 Low High High 
ў High High High 
4 High Low Dos 
5 Low Low Dow 
6 Low High Low 
7 ros Low High 
8 High Low High 


Note.—High: above the 


Median in the respecti uem 
tion. Low: below the median in the respective е зц. 
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Each S was instructed to consider each Е 
isolation and rate it on а 7-point scale as to ap- 
favorable it would be if it were true about p his 
plicant he was considering hiring to work EA check 
supervision. The $ also had an opportunity item by 
one of two boxes which indicated that this i cant 
itself would either completely qualify the ш ther 
for employment or disqualify him from 
consideration. ‚ over 
Each of the 600 items was evaluated к 
100 managers, and the item means and ЧИ item 
computed. The mean served as a measure measure 
favorableness, and the variance served as а manager 
of interrater agreement. One month after the Ion 
had rated the items at the school, the same ue Ей 
naire with the items rearranged was — ihi 
S. On the basis of the return (over 75 (Brown, 
percentage of períect agreement menm ГЫЙ 
Lucero, & Foss, 1962) for each item was ter (test- 
and used as a measure of the item's ee the per- 
retest) agreement. This measure is ory exactly 
centage of respondents who rated the i rticularly 
the same on both administrations, and is ей ог 
useful when dealing with items having res 
skewed distributions. ans, 
The three univariate distributions of E n 
variances, and  test-retest measures V was then 
dichotomized at the median. Each ow the median 
classified as being either above or below (variance), 
in favorableness, interrater ägreemèni di of 
and intrarater (test-retest) agreement. Thu resenting 
the 600 items fell into one of eight cells dd їп each 
а 25 factorial arrangement. From the ite са con- 
cell a hypothetical applicant was ve e random 
Sisting of 30 items. The only departure of the same 
Selection of items occurred when two 0 different 
type of items were chosen, such as en the eight 
ages for the same applicant. Thus, each f nonover- 
hypothetica] applicants was made up formations 
lapping, consistent, and homogeneous in tric char- 
that is, information with similar psychome made 
acteristics. For example, one applicant was interrater 
of items which had high favorability, a А secon 
agreement, and high intrarater agreemen 1 the 0р" 
applicant consisted of items having exact Б. con- 
Posite values, while a third applicant ay 
Structed of items having high favorabi ес 
interrater agreement, and low intrarater авт 0 
a fourth, etc, Table 1 presents the makeup 
eight hypothetical applicants. А structing 
A procedure similar to that used in Sor у ite 5 
hypothetical candidates from persona HE e for 
was employed to develop psychometric кету con” 
photographs. The original pool of photogral ency 
sisted of 39 photographs of Life Insurante ple 
Management Agency personnel. A developer ieee 
of 315 managers (a different sample of ) rate 
from those who rated the written Че tea 
cach photograph on а seven-place predi yu? 
havior rating scale. From the ratings and a fo est 
study, the Photograph mean, variance, an of the 
Tetest reliability were computed. The raking, 
photographs were also submitted to a facto 


ment, 
fal 


anal- 


| 
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ysis in an attempt to eliminate those photographs 
which were evaluated on the basis of quality or 
some general response set. 

Based upon the item statistics and the results of 
the factor analysis, eight photographs were selected, 
One each for the eight cells formed by dichotomizing 
the distribution of photograph means, variances, and 
Measure of intrarater (test-retest) agreement. The 
selection of the photographs represented the same 2° 
factorial arrangement as did the written information. 

The photographs and the hypothetical applicants 
Tepresented by written information were combined 
11 complementary and contrasting patterns. In the 
Complementary pattern, the photograph and written 
information were of the same relative level. That is, 
a photograph with high favorability, low interrater 
agreement, and low intrarater agreement _ was 
matched with the applicant represented by 30 items 
ОЁ written information all of which received highly 
Avorable ratings with low inter- and intrarater 
agreement, Thus, for Sample 1, the photograph and 
Written information were oí a complementary 
Value, 

The contrasting or cross-over pattern grouped a 
Photograph with written information of opposite 
Value. A photograph with high favorability and 
low inter- and intrarater agreement was paired with 
an applicant represented by written information of 
low favorability and high inter- and intrarater 
Agreement, Thus, for Sample 2, the photograph and 
Written information were of contrasting values. А 

5 а result of the above two methods of matching, 
two, 23 factorials were constructed. A test booklet 
Was prepared representing each of the 16 cells. The first 
Page of the booklet contained general information and 

rections. The first page was followed by a blank 
Page. The third page contained the photograph; 
the fourth page was blank; the fifth page the written 
information; the sixth page was blank; the last 
Page contained the photograph and written informa- 
10п combined, For each of the three correlate 
Situations (photograph, written information, photo- 
Staph and written combined) the managers were to 
Tate the prospective applicant on a nine-step be- 

avior description rating scale indicating relative 
Potentia] for success as a life insurance agent, make 
n employment decision to select, reject, or remain 

undecided for the applicant; indicate on а five-posi- 
‘On scale how the hypothetical applicant measured 
fe Against applicants the manager had interviewed 
he Past year, The managers were requested not to 
look ahead and there is no evidence that they did. 
Fac manager rated only one complete hypothetical 
“PPlicant. One month after the initial administration, 

© same booklet was mailed to each S for test- 
Tetest Purposes, The stability of the ratings are the 
Subject or another study and are reported elsewhere 
(Carlson, 1967b). The sample sizes are presented in 
Tables 2 and 3. 


Analysis 


The desi isted of two, 23 fac- 
; En of the study consiste Я 
‘orials, each with two covariates. The treatment 
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combinations were assigned to Ss randomly. The 
departure from equal cell frequencies is due to in- 
complete information or nonreturns. The three in- 
dependent variables were two levels of information 
favorableness and two degrees each of inter- and 
intrarater agreement. The dependent variable was 
the rating of the photograph and written information 
combined. The covariates were the separate ratings 
of the photograph and written information. 

The analysis consisted of a “step-wise” analysis of 
covariance using the general linear hypothesis 
model. The first step in the analysis was а 2° 
analysis of variance which provided comparative 
data. The second step consisted of treating the 
rating of the photograph alone as a covariate in an 
analysis of covariance within the 23 model. The 
third step treated the rating of the written informa- 
tion alone as a covariate within the 23 model. The 
fourth step used the separate ratings of the photo- 
graph and the written information both as covariates, 
The dependent variable for each step in the analysis 
was the rating of the photograph and written in- 
formation combined. By comparing the adjusted 
mean squares at the end of each step, the effect of 
the covariate may be examined. The adjusted mean 
square at the end of the fourth step represents some 
component of the interviewer's rating greater than that 
contributed by the best linear combination of the 
separate rating of the photograph and the written 
information, that is, some error or "clinical com- 
ponent" the interviewer can manufacture from the 
combined presence of the photograph and written 
data which is different from the separate ratings 
of the photograph and written information. 

The analytic procedure was repeated for both 
the complementary and contrasting pattern of hy- 
pothetical applicants. The original analysis had 
planned to treat the study as a 2* analysis of 
covariance, with complementary versus contrasting 
patterns as the fourth independent variable. How- 
ever, as can be seen from Tables 2 and 3, the regres- 
sions are more homogeneous within pattern of 
presentation than across the pattern of presentations. 
In addition, Tables 2 and 3 indicate that although 
the multiple correlations between the combined 
rating and the separate ratings of the photograph 
and written information are quite high, they seldom 
account for greater than 50% of the variance in the 
overall rating. Thus, there appears to be sub- 
stantial variance above and beyond that accounted 
for by the separate ratings and which may be 
differentially effected by the independent variables. 
The results of the analysis of variance and covari- 
ance are presented in Tables 4 and 5 while Tables 
6 and 7 present the observed and adjusted means. 


RESULTS 
Complementary Information 
Table 4 presents the results of the four- 


step analysis for applicants constructed of 
complementary information. Looking first at 
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ТАВІЕ 2 


STANDARD NORMAL REGRESSION 


PPLICANTS 
WEIGHTS AND MULTIPLE CORRELATIONS FOR APPLICA: 


CONSTRUCTED OF COMPLEMENTARY INFORMATION 


ich; abilit 
Low intrarater stability High intrarater stability 
Degree of Jd High interrater 
favorability Low interrater High interrater Low interrater agreement 
agreement agreement agreement 
Unfavorable 2d 
Bs .23 02 Al 67 
В; 45 48 :57 67 
Ris 13 .78 .61 43 
N 38 58 56 
Favorable 39 
Bs 36 38 —.08 ‚59 
В; -70 -67 81 79 
Ryan 74 -80 .83 45 
N 41 47 55 
- ssion 
à mal regne js 
Note.—Abbreviations: Bs = standard normal regression coefficient, rating of photograph; Вз = standare поро combine 
coefficient, rating of written information; Ri; = multiple correlation, Rating of photograph and written info! 
dependent variable, rating of photograph alone and wri i 


written information alone 


the effects of the covariates on the error mean 


т mean square for 
7o, while treating 
formation alone as 
error mean square 
by 47%. Using both the rating of the photo- 


he written informa- 


d e size. 
as independent variables; N = sample 
ean 
| А à rror m 
tion as covariates adjusted ide. informa- 
Square by 49%. Thus, the writte significa 
tion alone had by far the most The inter- 
effect on the error mean square. i 


: n- 
ritten 1 

active effect of the photograph € as CÓ 

formation when both were trea the 


to 
variates was negligible when compared. 
effect of the written information es nce an 
The results of the analysis of ipae quite 
the various analyses of covariance tatistically 
Consistent. For all four analyses a ptm 
significant. difference was observed 


TABLE 3 


STANDARD NORMAL REGREssiON W. 


EIGHTS AND Muttip: 
CONSTRUCTED oF CONTRASTING I. 


STS 
LE CORRELATIONS FOR APPLICAN 


NFORMATION 
ilit 
Low intrarater stability High intrarater stability 
Degree of rater 
es ы : А B interra 
favorability Low interrater High interrater Low interrater High т 
agreement agreement agreement in 

Unfavorable 42 

Bs ida 14 alg 14 

В; 44 30 59 AT 

1.23 46 31 .60 26 

N 43 53 49 
Favorable 4 

В, 18 29 11 d 

B. 79 49 81 72 

Rios 54 55 84 51 

N 55 48 40 


Note.—For abbreviations see note of Table 2, 
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TABLE 4 


ANALYSIS-OF-VARIANCE AND ANALYsIS-OF-COVARIANCE RESULTS ‘FOR APPLICANTS 
CONSTRUCTED OF COMPLEMENTARY INFORMATION 


1. Anova 


IL. Anacova photographs 


IV. Anacova photographs 


III. Anacova written кел ascen 


Е E? df MS F E* df MS F E? 
2 1| .30| 46 |00 1| 2 .32 |.00 
1038.92% EH 1 |1731 | 26.51**| 164 | 1 | 16.23 | 26.13**| .62 
461 |01) 1| 200] — 0| 1| 0| .09 [00 
5.97 {| 27| 26 1| 19|] 30 
5.34 1| 45|] 165 1| 27| з 
4553 1| 140] 2.14 1| 205] ‘os 
14 1| 23| 46 aj 40| 264 
` 374| 165 373 | 63 


т ; B = Favorability 
“Treatments: A = Intrarater agreement; В = Favorabili 
rea :A = E igreement; 7 atistic 
Epsilon squared, Peters and Van Voorhis’ (1940) statisti 
< .05 


km s 


the mean rating for applicants constructed of 
favorable as opposed to unfavorable items of 
mformation, (See the adjusted means im 
ables 6 and 7.) The other information 
Properties did not have a significant effect on 
€ mean ratings. Thus, although the co- 
Variates substantially reduced the total vari- 
ance in the rating of the combined informa- 
101, a significant difference remained between 
the mean ratings for applicants constructed 
gi favorable as opposed to unfavorable in- 
9Tmation, Apparently some meaningful ves 
ance exists in the rating of the photosrap 
Written information combined beyond 

. at contributed by the ratings of the written 
'nformation alone and the photograph alone. 
he relationship between the main treat- 
Ment effects and the rating is indicated Li 
epsilon squared in Table 4 (Peters & Van 
Sorhis, 1940). Epsilon squared is an pepe 
estimate of the correlation ratio and, as such, 


z; С = Interrater agreement. 


for the unbiased estimate of the correlation ratio. 


indicates the strength of the association be- 
tween a treatment effect and the dependent 
variable. In the absence of a covariate, 
epsilon squared was .75 between the favor- 
ability of information and the final rating. 
When the rating of the photograph was 
treated as a covariate, epsilon squared for the 
favorability of information dropped only 
slightly to .73. When the written informa- 
tion was treated similarly, epsilon squared 
dropped to .64, and when both the photograph 
and written information were treated as 
covariates, the favorability of the information 
still produced an epsilon squared of .62. Thus, 
not only was the mean difference statistically 
significant, but the degree of association 
between the favorability of information and 
the final rating was also significant. 

Another way to show the strength of the 
relationship between the favorability of the 
information and the overall rating of the ap- 


TABLE 5 


ANALYSIS-OF-VARL 


ANCE AND ANALXSIS-OF-COVARIANCE RESULTS FOR APPLICANTS 
CONSTRUCTED ок CONTRASTING INFORMATION 


IL. Anacova photographs 


III. Anacova written | IV- Anacova photographs 


and written 


dí| MS F E | df | Ms | F E? | of | MS F E: 
.86 76 .00 1 32 44 00 1 
i 1 лз 1 | 102128 | 13-20%] 72] 1| 56 | rio | 00| tes | 235 | 00 
C 1| 1009.43 1 17.02 -04 1| 1.20 | 1.66 | .00 1| 164 | 238 | ‘00 
hn 1 15.55 1 15.14 1|132]| 1:83 1| 102| 148 
AC 1 1| 1908 1| 2.05 | 409 1|381]| 5:51 
Be 1 1 9.03 З 1| .o3 04 1| 09 as 
noe 1 1 161 147 asal d$] 2 1f 251 E 
ы Е. 5 а 
Breo lagi 350 11 355 | 68 


Note.—See footnotes of Table 4. 
ab < .05. 
b < 01. 
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айс effect beyond that contributed by the best 
linear combination of the separate elements 
of information. However, when the informa- 
tion was complementary, there was а signifi- 
cant and systematic effect due to the favor- 
ability of the information used to construct 
the hypothetical applicants. This effect was 
greater than the best linear combination of 
the separate pieces of information, 
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idi ional scaling methods were used to determine the dimensions of 
epee in a specific job setting. 18 behavior ag клы 
to interpersonal relations in а management-analyst position m 8 (А а 
government were developed. Job incumbents judged the анну р E 
statements, Data were collected and analyzed by both the tra аз E. 
dimensional scaling method and the rcp ринит pee» 
i i nal relations in the job. / а f t : 
msi ne es quiete ЈА indicated that they produced similar results. In 


view of certain 


administrative advantages of the A-technique, further use of 


the A-technique in analyzing job domains seems justified. 


. An analysis of job content or worker ac- 
tivity is а basic part of many types of per- 
Sonnel research investigations. For example, 
some form of job or worker analysis seems 
“ssential in the areas of test construction and 
validation, training development and evalua- 
Оп, personne] appraisal development, etc. 

Ormation resulting from such an analysis 
Tequently is used to direct the approach taken 
© Subsequent research and development tasks 
and to provide a basis for directly relating 
the Measuring instruments, training courses, 
ete., to the job with which they will be used. 
b Uantitative job analyses frequently are 
аѕе on evaluations made in accordance 
with some a priori definition selected by the 
"estia tor. that is, judges are instructed 
9 evaluate specified aspects of the job in 
terms of a particular rating consideration. 
П such procedures, the investigator assumes 
that he has selected the quality most ap- 
Propriately related to the decision. In many 
stances, however, raters’ true ан 
ау not represent а single dimension bu 
May be the result of a composite which i 
cludes several dimensions. A technique whic 
enables the rater to evaluate the work without 
TéStrictions on the way in which he perceives 
1 would appear to be a better approach to 
rive the actual factors of the job. — 

A similar situation occurs when considering 
the nature of each of the separate factors 
identified as essential in the job. If, for ex- 
— 


" This article is based on a doctoral ЖЕ he 
Completed at the University of Maryland un 
rection of C. J. Bartlett. 


ample, administrative ability is determined to 
be involved in a certain occupation, a ques- 
tion arises as to what the term administra- 
tive ability actually means in this job con- 
text, that is, what are the dimensions under- 
lying the concept. General terms such as 
human relations, administrative ability, etc., 
are rather vague, with different meanings 
associated with them by different people. In 
order to identify the specific job aspects which 
should be considered in establishing ap- 
propriate qualification requirements and in 
developing devices for obtaining valid predic- 
tions of successful job performance, an anal- 
ysis of each important factor should be con- 
ducted in such a way as to reveal the basic 
dimensions underlying the factor. 
Multidimensional scaling analysis (Torger- 
son, 1958) provides a method for determin- 
ing the fundamental dimensions of complex 
variables for which the psychological con- 
tinuum is composed of a complex of two or 
more dimensions. This method differs from 
traditional unidimensional scaling in that, with 
multidimensional scaling, the minimum di- 
mensionality of a set of stimuli is determined 
without influencing the raters? judgment by 
requiring them to evaluate the stimuli in 
terms of the investigator's arbitrarily chosen 
definitions. The idea of multidimensional 
scaling originated with Richardson (1938) 
but did not receive much attention until re- 
search by Torgerson (1952), Abelson (1954), 
Messick (1956b), and others illustrated its 


potential applications to various psychological 
problems. 
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The traditional multidimensional scaling 
technique consists of several stages. First, a 
set of scale values representing relative dis- 
tances between stimuli is obtained. Then, these 
relative distances are converted to absolute 
interstimulus distances by the use of an ad- 
ditive constant. Finally, the dimensionality 
of the space that describes the set of absolute 
distances is determined, and the Projections 
of the stimuli on the axes of this space are 
obtained. Schultz and Siegal (1964) and 
Siegal and Pfeiffer ( 1965) recently applied 
the traditional multidimensional scaling tech- 
nique in a job-analysis situation for the pur- 
pose of developing a criterion measure for the 
Position of aviation electronics technician in 
the Navy. The stimuli for these studies 
covered job tasks ranging from the perform- 
ance of housekeeping duties and routine 
operations to the use of schematics and test 
equipment. 

Andrews and Ray ( 1957) have suggested 
a different multidimensional approach which 
involves the transformation of the propor- 
tions of common elements between stimuli 
into estimates of correlation coefficients which 
can then be factored by the usual factor- 
analytic methods. This multidimensional pro- 
cedure was named the A-technique. The 
method is based on the logic that an ас- 
ceptable estimate of the Proportion of com- 
mon elements in sets of data is the coefficient 
of determination (7*), and, therefore, it is 
equally true that an acceptable estimate of 
r is the square root of the proportion of 
common elements, 

The present research was an 


investigation 
of the use of multidimension 


emonstrate the 
1 mensional scaling method 
in the analysis of job domains, (5) to com- 


pare the results of two multidimensional ap- 
proaches, and (с) to determine by multi- 
dimensional analysis the dimensions underly- 


R. Brown 


: ions in à 
ing the concept of interpersonal relatio 
specific job setting. 


METHOD 


tional 

The investigator, with the aid of an ar 
specialist, developed 53 béhsvior sue nal re- 
were related to the domain of үзен alae in 
lations for the position of managemen + analysts 
the Federal government. Six managemen' statements 
working individually, divided the 53 which de- 
into 3 Eroups by selecting the pews er in 
scribed behavior considered most impor items COD" 
management-analyst position and the 18 items wer 
sidered least important. The remaining tance. The 
considered to be of intermediate impor' (for most 
Statements were scored on a scale of 1 roup int? 
important) to 3, depending on the id for ea 
Which they were placed, The mean rati the 18 
behavior statement was calculated, re selected 
statements with the lowest mean ratings tements are: 
for inclusion in the study. These 18 state 


l. Presents ideas and recommendation | 
affected persons or groups are not offende get à job 

2. Cooperates with fellow workers to and 
done. isor 

3. Maintains good relations with supervis 
other higher officials, the point. 

4. Expresses himself effectively—to 


an- 
ther org? 
5. Deals effectively with members of 0 
izations, 


lect information, 


а 
s ent-an: 
9. Convinces Officials to use managem 
techniques, 


0 
гоуа1 
10. Negotiates with management for арр 


lysis 


5 f 
proposals and recommendations. ndations ? 

1l. Explains results and гесотте! n 
studies to management. on whe 


12. Develops an acceptable course of E differen! 
different Points of view are advocated by 
People. I ved. 
13. Coordinates plans with all others invo! 
14. Listens to viewpoints of others. resentful. 
15. Accepts criticism without getting to 5 
16. Works as a member of a team 
management problem. 
ie wane fone accessible to DIRE as ы 
18. Sells changes in management ae с or hav 
Operating officials prefer previous metho 
“Det” ideas. 


{ py three 
imuli bY 
The subjects (Ss) rated the 18 stimu 
different methods: of 


з thod 

1. In terms of the multidimensional. M^ 19564). 
Successive intervals as suggested by Mess arity о. 
This method required Ss to rate the v ul on 
all possible pairs of stimuli. Each pair wa: e" 
E CEDE d the method of nonserial mot ре 
Case III of the A-technique, In this meth 


—————————S— ч 
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stimuli were presented to $ in the form of two 
lists, each containing the same behavior statements 
but in different order. For each statement in the 
first list, S selected the statement from the second 
list Which was most similar to it. 

3. In terms of four specified rating considerations 
(Consideration, Directing and Controlling, Difficulty, 
and Importance) which were believed to be pertinent 
to the concept being studied. Each stimulus was 
rated on a 7-point scale in accordance with each 
ОЁ the four rating considerations. 


Information obtained by the third rating method 
Was used as an aid in interpreting factors resulting 
rom analysis of the data produced by the first two 
rating methods. | 
* sample consisted of 120 civilian employees in 
* Dosition of management analyst in an agency 
the PE Federal government, Data collected from 
ae sample by application of the multidimensional 
method of successive intervals were analyzed by 
© traditional multidimensional scaling method, 
and data collected by application of the method of 
“nserial matching were analyzed by the A-technique. 
s ic, ће traditional method, the successive-intervals 
lution developed by Diederich, Messick, — Ps 
ater (1957) was used to obtain the matrix о 
ciative interstimulus distances. The procedure sug- 
+ aa by Messick and Abelson (1956) was used to 
tttmine the additive constant for use In translat- 
* scale values to absolute distances poche 
an ; 3n absolute zero point. This method ES pes 
it Initial estimation of the constant р ро. аа 
inn procedure to eliminate the dis н. 
"Oduced by the estimation. The resulting matrix 
absolute interstimulus distances, with таз ш 
diagonals, was transformed to a sca gepro- 
a matrix by the procedure suggested by ber m 
es Who reasoned that the origin shou 
Placed at the centroid of all the stimuli. — 
the | Scalar-product matrix was factor апа — 
© Principal-axes method, and the major cC 
“te rotated by the Varimax method suggeste Ly 
1 ш (1958). The factor loadings, in this сазе, ae 
esitimately ‘exceed 1.00 since the values are 
fones of angles but are scale values of the pro- 
*ctions of the stimuli on the axes of Ше ENS ыр 
of n the A-technique, the frequency of е р т. 
Stimuli was plotted, and the corresponding sim 
Portions (ratio of frequency of selection to possi 
x Queney of selection) were computed. A Aa 
OOt transformation of these proportions was m 


‚ Produce estimates of the correlations between 


Stn Р i analyzed 
by "tli. The resulting matrix was factor tion was 


а the principal-axes method, and rota 
‘complished by the Varimax method. 


of 


RESULTS 


One of the objectives of the present pid 
ation was to compare the A-technique WI 

е traditional multidimensional scaling 
method to determine if these two approaches 


5 


lead to similar results. As the first compara- 
tive analysis, the 20 largest and 20 smallest 
absolute interstimulus distances írom the 
traditional multidimensional scaling analysis 
were compared with the estimated correlation 
coefficients derived from the transformation 
procedure used in the A-technique. The re- 
sults are contained in Table 1. 

Since small absolute interstimulus distances 
indicate that the stimuli are perceived as 
being closely related, one would expect that, 
if the stimuli were perceived in the same 
manner in each of the multidimensional anal- 
yses, stimulus pairs with small absolute dis- 
tances also would have substantial correla- 
tion coefficients. Similarly, stimulus pairs 
with large absolute interstimulus distances 
would have produced small correlation coeffi- 
cients in the A-technique analysis. The results 
shown in Table 1 substantiate this expecta- 
tion. Of the correlation coefficients for the 20 
largest interstimulus distances, 16 were .00. 
The highest correlation was only .11. On the 
other hand, the correlation coefficients for the 
20 smallest absolute distances ranged from 
.25 to .83, with 15 of the coefficients being 
above .40. 

The traditional multidimensional analysis 
resulted in the identification of five major 


TABLE 1 


COMPARISON OF THE 20 LARGEST AND 20 SMALLEST 
ABSOLUTE IxTERSTIMULUS DISTANCES WITH THEIR 
CORRESPONDING ESTIMATED CORRELATION} 
COEFFICIENTS 


Smallest distances Largest distances 


Stimulus] Absolute} Estimated | Stimulus] Absolute Estimated 
pair | distance | correlation pairs | distance | correlation 
6-17 Ё 8-18 3.36 00 
2-16 К 6-15 3.35 00 
[2 . 9-17 3.21 00 

- : 6-18 | Зло :00 
= 4 7-15 3.17 00 
10-11 B 9-15 3.15 00 
ri .93 6-10 3.15 .00 
з» 93 17-18 3.13 .00 
2-13 D $5 ET .00 
b "m „12 06 

1218 . 8-11 3.11 .00 
12-13 UH 8-10 3.06 .06 
are 131 4-15 3.05 200 
tis | b 1-17 | 302 100 
9-18 120 2-9 2.99 .00 
3-5 121 15-17 2.97 wll 
5-12 123 2-11 2.96 .00 
СЕ 12 11-17 295 .06 
$ 2.94 .00 

4-18 1.26 8-9 2.91 .00 


a Numbers ге 


mete fer to the stimuli listed under the Method 
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TABLE 2 


ROTATED Factor MATRIX FOR THE TRADITIONAL 
MULTIDIMENSIONAL SCALING ANALYSIS 


Factor 
Stimulus* 
$ п п IV у 
1 .64| —.28| —.65 22 95 
2 —.70| —.21 17 | —1.20 | —.63 
3 — 12 1.06 04 27 35 
4 18 | —.46 A8 1.26 16 
5 —.07 14 05 | —.12 63 
6 —191| —.30| —.10 | —.20 09 
7 250—103] —.54 56| —.56 
8 —.23 04 2.11 | — .12| —.18 
9 -46 | —.26| —.20 1.42} —.30 
10 .87 02] —.58 55 | —.07 
11 .25 —.04| —.59 1.21 01 
12 -84 | —.28| —25 — 53 -46 
13 :09 | —.41 .00 —.83 46 
14 —.21 .67 -65 | —1.02 05 
15 52 L88| —23 | —.69| —55 
16 —.12 | —.48 65 | —.85| —.89 
17 =175 14 20 | —.62 00 
18 101 | —.20| —.gg .69 01 


a Numbers refer 


to the stimuli listed under the Method 
section. 


factors. The rotated factor matrix is found in 
Table 2. 


The loadings suggested the following fac- 
tor descriptions: 


Factor I—Tact in Personal Contacts. Major 
Items: Sells changes in management prac- 
tices when operating officials prefer previous 
methods or have "pet" ideas, negotiates with 
management for approval of proposals and 
recommendations, develops an acceptable 
course of action when different points of view 
are advocated by different people, and presents 
ideas and recommendations so that affected 
persons or groups are not offended. 

Factor IIL—Accepting Others’ Viewpoints. 
Major Items: Accepts criticism without get- 
ting resentful, maintains good relations with 
supervisor and other higher officials, and 
listens to viewpoints of others, 

Factor III—Information Collection. Major 
Ttems: Interviews Supervisors and employees 
to collect information, listens to viewpoints 
of others, and works as a member of a team 
to study a management problem. 

Factor IV—Verbal Persuasiveness. 


я Й Мајог 
Items: Convinces officials to use manag 


ement- 
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ес- 

analysis techniques, expresses Bst Әри 
tively—to the point, explains Matri Loi 
recommendations of studies to pec 
and sells changes in management ate 
when operating ысу prefer P 

thods or have “pet” ideas. Js 
kc V— Controlling People re 
sideration. Major Items: Presents 1 ah ot 
recommendations so that affected inr B 
groups are not offended, deals effectiv lops 
members of other organizations, dev fieren 
acceptable course of action when different 
points of view are advocated by 11 others 
people, and coordinates plans with а 
involved. in the 

The A-technique analysis nea rotated 
identification of seven factors. 
factor matrix is found in Table 3. 

The loadings resulting. from E 
nique analysis suggested the following 
descriptions: 


A-tech- 
factor 


h Сой" 
ffectivelY 


; А at а 
ideas and recommendations so be develops 
Persons or groups are not offended, 


TABLE 3 
IE 
Rotatep Factor MATRIX FOR Т? 


A-TECHNIQUE ANALYSIS -—— 


Factor 
Stimulus* vil 
п {шту [ум d 
1 |в) .06|—.02|—.o1] 26| 45 -0 
2 jaz .n| л9| .87| -02 E -e 
3 4| .36| .04| .17| -02| > 49 g 
4 [|.26|—.15|—.01|—.12| -21 10 A 
5 L7 01) .13| .03]—04 ^ "0; o 
6 |.08}—.04] .o3| .12| .06 08 09 
7 02| —.04| .06| .10| .81 03 r^ 
8 [08| .04| .04| .17| .03 123 ^ 
9 07—.02|—01| .01| .62 7l - 
10 A7| .09|—.02| .02| .28 95| = 
11 05| .02| .02| .05| .05 07| -03 
12 65] .12| .02| .05| .21 05 r^ 
13 .54| —.02| .04| .42|—.04 n Ps 
14 jai .70| .19| .06| 60у= 0 
15 |.09) .92| .o1/ .04| 02) +; 2 
16 |.04 .03|—.01| .90| .04 03 03 
17 :05] .14| .93| .05|—.03 07| = 
18  |.28| 11| —.03| —.08| .80| - 


ne Meth? 
e Numbers refer to the stimuli listed under th 
section. 
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an acceptable course of action when different 
points of view are advocated by different 
People, and coordinates plans with all others 
Involved. 

Factor II—Accepting Others’ Viewpoints. 
Major Items: Accepts criticism without get- 
ting resentful, listens to viewpoints of others, 
and maintains good relations with supervisor 
and other higher officials. 

Factor ITI—A doublet: Helps people who 
ask for assistance and makes himself accessible 
to others. These items reflect situations in 
Which other people contact the management 
analyst to request his services; a tentative 
Пате for this potential factor might be Pro- 
viding Requested Services. 

Factor IV—Cooperation. Major Items: 

orks as a member of a team to study a 
Management problem, cooperates with fellow 
Workers to get a job done, and coordinates 
Plans with all others involved. . 

actor V— Persuasion through Logic. Major 
tems: Promotes the use of new ways of doing 
ings, sells changes in management practices 
When operating officials prefer previous meth- 
9ds or have "pet" ideas, and convinces offi- 
cials to use management-analysis techniques. 

Factor VI—Verbal Expression. Major 

tems: Explains results and recommendations 

Studies to management, negotiates with 

anagement for approval of proposals and 

recommendations, and expresses himself ef- 
&ctively— oint. | 

Factor uibs Collection. Major 
Items; Interviews supervisors and employees 
{0 collect information, listens to viewpoints of 
others, and expresses himself effectively—to 

€ point. 

comparison was made of the factors 
resulting from each multidimensional analysis. 

e comparison is summarized in Table к 

he factors which appear to be most closely 
related are found in the same row of the 
table. Тп addition, the product-moment cor- 
relation between the factor loadings for the 
two related factors is shown in the _last 
Column of the table. Since the traditional 
multidimensional method produces bipolar 
factors while the A-technique does not, one 
Would not expect congruence coefficients E 

€ especially high. This condition would bs 
the result of the A-technique procedure whic 


TABLE 4 


Comparison oF Factors OBTAINED FROM THE A- 
TECHNIQUE WITH Factors OBTAINED FROM THE 
TRADITIONAL MULTIDIMENSIONAL SCALING 
МЕтнор 
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Traditional multidimen- 
sional scaling factor 


A-technique factor 


1. Tact in personal con- 


tacts 
TI. Accepting others’ 
viewpoints ы 
III. Information collection 


IV. Verbal persuasiveness 
V. Controlling people 


through considera- 
tion 


III. Providing requested 


services 
II. Accepting others’ 
viewpoints 
VII. Information collection 
IV. Cooperation 
V. Persuasion through 
logic 
VI. Verbal expression 
I. Controlling people 
through considera- 
tion 


a Product-moment correlation between loadings оп the two 
related factors. N = 18. 


restricts the interstimulus correlation matrix 
to zero or positive correlation coefficients. 
Therefore, the product-moment correlation or 
shape coefficient was used to compare factors 
in this study. 


Discussion 


Previous research studies (e.g., Halpin & 
Winer, 1957; Rupe, 1951) conducted for the 
purpose of determining the dimensions of 
interpersonal behavior in a work situation 
generally have resulted in the identification of 
two major factors: sensitivity to the feelings of 
other people, and directing or controlling the 
behavior of other people. These dimensions 
have been referred to by various names, per- 
haps the most popular of which have been 
Consideration and Initiating Structure. The 
findings of the present research, while spe- 
cifically related to the position of management 
analyst, also are related to these major factors. 
For example, Factor IV from the traditional 
multidimensional analysis and Factor V from 
the A-technique analysis were interpreted as 
“persuasion” factors which seem related to 
the factor of Initiating Structure. 

Factor V of the traditional analysis and its 
counterpart factor from the A-technique, 
Factor Т, are of particular interest in this 
regard. These two factors are related to the 
dimension of Consideration as shown by the 
correlation of stimulus factor loadings with 
the ratings assigned to the stimuli when 
evaluated by the sample in terms of the 
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degree of consideration involved in the be- 
havior described by the statements. The cor- 
relations for these two factors were .62 and 
.66, respectively. The two factors also сог- 
related .63 and .59, respectively, with the 
ratings assigned in terms of the degree to 
which the behavior involves the ability to 
direct or control the behavior of other people. 
The correlation of these factors with both 
Consideration and Directing and Controlling 
may be a finding related to staff positions, 
such as management analyst, in which direct 
authority for implementation of proposals is 
vested in line officials. In many instances, 
the staff man gains the acceptance of line 
officials by taking actions such as compromis- 
ing to reach an agreement, cooperating with 
them so that they cooperate with him, etc. 
In other words, he must be considerate of 
their opinions, feelings, etc., so that he can 
maintain some degree of control over their be- 
havior. Some recent research conducted by 
other investigators (Fleishman & Harris, 
1962; Fleishman & Peters, 1962; Rim, 1965) 
also has suggested that the individuals who 
are most effective in influencing others are 
those rated high on both Consideration and 
Tnitiating Structure, 

The results shown in Table 4 indicate con- 
siderable agreement in the factors identified in 
the two different multidimensional analyses, 
Factors I, II, IIT, and V from the traditional 
multidimensional scaling analysis each appear 
to have a counterpart factor in the A-tech- 
nique analysis. The investigator’s interpreta- 
tion of Factor I from the traditional analysis, 

however, varies considerably from the inter- 
pretation of its counterpart factor, Factor 
TIT, from the A-technique analysis. The nega- 
tive pole of the traditional multidimensional 
scaling factor definitely coincides with the 
single pole of the A-technique factor which 
was tentatively interpreted as Providing Re- 
quested Services. However, the Positive pole 
of the traditional multidimensional scaling 
factor, especially the inclusion of items such 
as 1, 12, and 15, suggested that the factor 
involved tact. The tentative interpretation 
of the A-technique factor was based on a 
doublet consisting of Items 6 and 17 which 
did not permit an interpretation inv 


olving 
tact. 
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A second major difference between the 9 
sets of factors is that the traditional met! P 
produced five factors while ыа Аш 
produced seven factors. The additional А- F : 
nique factors seem to occur in the form phe 
finer division of the Verbal pen cm 
factor (Factor IV) írom the ОГ 
multidimensional analysis. Andrews wis Es 
(1957) have indicated that the — A 
sometimes produces two individual fa a 
rather than a single bipolar factor жапе 
negative roots are not used in the pari 
root transformation which is applied M the 
A-technique procedure for estimating The 
interstimulus correlation coefficients. od 
negative pole of the Verbal Pes ж 
factor is composed of “cooperation pies eis. 
is Factor IV from the A-technique erm in 
The positive pole of the Verbal Persuasiv E 
factor includes the items which involve pe! 
suasion as well as those which eia 
marily verbal expression. The ecd 
the other hand, makes a distinction = > 
these two types of items. Thus Fac QM s 
from the traditional analysis appears to Iting 
composite of Factors IV, V, and VI resu 
from the analysis by the A-technique. d by 

The differences in factors identifie ahi 
the two multidimensional techniques tors 
point up the problem of the number of ne dE 
to be extracted. In the present Varr Sue 
number of factors rotated in the д оз 
analysis was based оп the number ОЁ i the 
with eigenvalues greater than 1.00. h, the 
traditional multidimensional approac M asp 
decision as to the rank of the matrix "investi- 
What more subjective. Normally, the en. i- 
gator attempts to determine the ране 
mensionality that provides ап ane e" 
the data. In the present research, five fac- 
proach led to the decision to retain neces 
tors. However, such a decision is not ployed 
sarily equated to that which was p^ 
with the A-technique. If six factors are alysis» 
for the traditional multidimensional ка high 
the sixth factor is a verbal factor W! se wit 
loadings on Items 4 and 11, as is the Sa Thus: 
Factor VI of the A-technique analy: dition 
the retention of six factors in the tra in line 
analysis brings the results even more nique: 
with those obtained with the A-tec 
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TABLE 5 


Comparison оғ Factors FROM THE Two Mutti- 
DIMENSIONAL ANALYSES WHEN Six Factors ARE 
ROTATED IN THE TRADITIONAL ANALYSIS 


Traditional multidimen- 


sional scaling factor A-technique factor 4 


I 


+ Tact in personal con- 
tacts ser єз 

+ Accepting others’ II. Accepting others’ 83 

топ, таура viewpoints i 
Information collection | VIL. Information collection) .00 


11. Providing requested 
ces 


IV. Persuasion IV. Cooperation —.62 

through logic У. Persuasion є E 
through logic 

V. Controlling people I. Controlling people лі 


through considera- through considera- 
Vivis tion E ; 
* Verbal expression VI. Verbal expression EI 


" " 
rela Eoduct-moment correlation between loadings on the two 
ated factors, N = 18. 


The correlations between factors are shown 
In Table 5, 

The overlap in interpretation of factors 
resulting from the two separate multidimen- 
Slonal analyses and the indication of a rela- 
tionship between the relative magnitudes of 
the stimulus loadings on counterpart factors 
Mdicate that the two different methods of 
multidimensional analysis produced similar 
results, The factors of interpersonal relations 

the management-analyst position suggested 

Y the results of the various multidimensional 
Nalyses are: Tact in Personal Contacts, Ac- 
cepting Others’ Viewpoints, Information Col- 
ection, Cooperation, Persuasion through 

gic, Verbal Expression, and Controlling 

ople through Consideration. 
he A-technique (Case III) has several ad- 
Yantages over traditional multidimensional 
Scaling in that the method of presentation of 

€ data is relatively simple, and the task im- 
к ‚оп the subject is relatively easy to ac- 
c Mplish. The ease with which data can be 
есед for the A-technique permits the ех- 
Pansion of the list of stimuli to cover more 
bili behaviors, thereby decreasing. the possi- 

"ty of omitting some significant job factors. 
fur View of these administrative advantages, 
tr ther use of the A-technique 1n lieu of 

aditional multidimensional scaling for the 
"alysis of job domains seems justified. 
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A MULTIDIMENSIONAL SCALING ANALYSIS OF THE 
JOB OF CIVIL DEFENSE DIRECTOR? 


ROBERT J. SMITH? axp ARTHUR I. SIEGEL 


Applied Psychological Services, Wayne, Pennsylvania 


xamination was performed, through multidimensional analytic scaling 
re of the complex job of the Office of Civil Defense (OCD) ge epe 
35 regional and Headquarters staff judged the similarity of 34 ши 
task functions culled from OCD plans oí 7 states. 3 bipolar factors emerge 
from the subsequently factored matrix: (1) internal vs. external system main: 
tenance, (2) routine vs. emergency programming, and (3) resource use vs. 


resource evaluation. A 4th factor, 


labeled emergency system integration, was 


less clear and appeared unipolar. It is concluded that multidimensional scaling 
analysis is a practical approach for defining complex jobs. Such defining 
would permit subsequent unidimensional measurement, The factors found may 
be used for selection, training, etc., of OCD directors. 


Multidimensional scaling analysis has been 
shown to be an extremely practical technique 
for the classification or ordering of complex 
entities. The method has been demonstrated 
to produce results which agree with those 
obtained through other techniques (Helm, 
1959), and has been applied to areas ranging 
from studies of attitudes (Messick, 1954) to 
relatively simple job skills (Siegel & Schultz, 
1964). 'The important job of Civil Defense 
Director within the Office of Civil Defense 
(OCD) offered a particular challenge to the 
present investigators because: (а) a plethora 
of skills was clearly involved; (b) reducing 
them to meaningful dimensions without alter- 
ing their essential complexity would permit, 
among others, subsequent performance evalua- 
tion and an approach to selection and train- 
ing; and (c) a clearer delineation of similar 


th in and out 
of government might be facilitated. 


1 This study was co 
PS-64-30 between Applied Psycholo; 
the Office of Civil Defense, 
Army, while the senior author was а member of 
the staff of Applied Psychological Services, The 
authors express their indebtedness to Dorothy 
Fletcher, D. MacPherson, and D. R. Saunders for 
their assistance. 

?Now lecturer, University College, University of 
Maryland. 


mpleted under Contract OCD- 


gical Services and 
Department of the 


METHOD 


m first 
As with any standard job analysis it ini 
necessary to develop a list of the tasks ы “task 
by Civil Defense Directors, To this p were 
cards” describing single aspects of the couched 
developed. These single statements M. pub- 
in the language contained in the plans ing wide 
lications of OCDs of seven states havi 
geographic coverage.? апа 
The "CD publications of these sata о task 
lyzed and a library of approximately da 
data cards was established. These data Lis 
reduced to approximately 1,500 tasks с languag? 
generalizing and summarizing to a ке states: 
suitable to the publications of all puer" 
Further summary and generalization У! e: 
Statements related to state-level OCD орап 
These 300 statements were classified acc 


ations 


д action , - 
several schemes, including relating EUM the civil 
the appropriate service or position wl " 
defense organization. пу task 


For purposes of the present perm an 
relating to the civil defense agency, its ‘items ere 
deputy director, were considered. кше? recas! 
reconsidered, combined, rephrased, and p retaine’ 
Produce a list of 34 task functions, whic s as 
as much of the sense of the original item sition 
sible and which were associated with the Р 
the OCD director (Table 1). 


Stimuli 


The Civil Defense Task Inventory w 1 
in accordance with the method of Ее pr he 
intervals. The stimuli to be judged we age of i 
in booklet format. At the top of each pag ov. 
booklet, 1 of the 34 task functions W^ ctio 


e 
Below it, at the left side of the page, th with 


appeared which were to be compare QN i 
EE rm en issouTl- ^^ on 
*States included were California, Missout! 


ania, 
Carolina, Oklahoma, Oregon, PennsylV 
Vermont, 
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Tue Jos or Сгуп, 


"standard" stimulus at the top. Within the booklet 
the pages were arranged (to control for sequence 
effects) in one of four orders. Each order was de- 
termined randomly and each booklet contained 20 
Pages. Item orders on any inventory page were 
randomly assigned, Only unidirectional comparisons 
Were involved. Thus Page “A” contained 34 state- 
cee 1 of which was enclosed in a box at the top 
refi е page as a stimulus to be compared with the 
Е 33. The initially boxed statement was then 
Av inated and, on Page “В,” 1 of the remaining 33 

а5 judged against 32 statements, and so on until 


only A K к x 
nly 2 items remained for comparison with one 
another, 


Subject-Raters 


i raters were 34 males and 1 female serving 
йү variety of supervisory-level OCD positions. 
from Gan from OCD Region II headquarters, 12 
head, CD Region I headquarters, and 13 from ocD 
Qu ets in Washington, D.C. Subjects (Ss) 

Screened on the basis of depth of experience 
unet arity with the various aspects of OCD 
oim ne For example, their positions ranged 
B Tegional field officers to public information to 
nning specialists. 


Procedure 
T 


thee Taters were to estimate the similarity of each 
Uncti, function of the inventory with the single 
tween a at the top of each page. Judgments be- 
item this comparison item and each remaining 
" i ES made on an 11-point scale ranging from 
Point different” (11), through an undefined neutral 
Was t ), to “very similar” (1). The rater's task 
which, make a check on the line under the number 
of Corresponded to his conception of the similarity 
е given “standard” stimulus (boxed) task 


Оп and the comparison task function. The S, 


fancti 
to) his 


ce, c s 
Own p recorded (і.е. assigned a number 


The Ponse, 
tion E data were collected separately at each loca- 
> trior to completing the form, the judges were 
& brief explanation of the overall purposes of 
rogram, They were then asked to read the 
Sent Page of the inventory and to ask questions i 
throu, ату. The judges were then left free to procee 
tio Eh the inventory at their own pace. Comple- 
ìme among Ss ranged from 45 to 90 mim. 


Biven 
t 


Coy, 


Rrsutts AND DISCUSSION 
u idi H ч . 
ltidimensional Scaling Analysis 


ee each function pair, the similarity judg- 
Valu S of the 35 Ss were pooled and median 
15, obtained. For purposes of the present 
i imensional scaling method, this scale 
ica} 28 interpreted as the relative psycholog- 
Чоп, istance between the pairs of task func- 
the The goal of the analysis is to determine 
Umber of axes in the space which ac- 
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TABLE 1 


FINAL List or THE OCD DIRECTOR'S 
Task FUNCTIONS 


1. Representing the executive branch in CD matters. 
2. Organizing headquarters staff. 
3. Assisting subordinate groups in establishing their 
CD organizations. 
4. Directing subordinate CD groups. 
5. Appointing CD technical advisory committees. 
6. Assigning CD functions to other governmental and 
private agencies. 
7. Administering the protected facilities program. 
8. Prescribing mobilization procedures. 
9. Alerting and mobilizing the CD system, 
10. Assuring the operational readiness of the CD 
system. 
11. Preparing and presenting a CD budget. 
12. Preparing and implementing mutual aid agreements 
with related organizations. 
13. Inspecting and reporting on installations assigned 
to or related to CD. 
14. Assisting in legal actions arising from CD activities. 
15. Issuing necessary emergency orders and instruc- 
tions to the public. 
16. Advising on needed CD legislation. 
17. Prescribing information channels. 
18. Relaying information from higher-level CD or- 
ganizations. 
19. Informing and advising executive branch and other 
governmental organizations on CD matters. 
20. Assuring the proficiency of CD workers. 
21. Programming the continuity of government. 
22. Establishing the order of succession within the CD 
system. 
23. Assuring the preservation of essential CD records. 
24. Coordinating all CD activities. 
25. Accounting for CD funds and property. 
26. Arranging for fiscal and logistical support for CD 
activities. 
27. Maintaining liaison with federal and state military 
groups. 
28. Informing public and private groups of CD ac- 
tivities. 
29. Conducting required research. 
30. Evaluating potential emergencies. 
31. Determining the availability of human and material 
resources. 
32. Preparing CD plans. 
33. Coordinating plans with those of other CD levels. 
34. Conducting and evaluating CD tests. 


count for the structure defined by these dis- 
tances among all the stimuli, and to determine 
the projections of each stimulus on the axes. 
Having attained the scaled between-task 
distance values, the Messick-Abelson (1956) 
general solution to the additive constant prob- 
lem was applied to the data. This resulted in 
a value to be added to the original scaled dis- 
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negative and positive loadings involve tasks 
that represent essentially dichotomous func- 
tions when viewed with regard to the broadly 
defined labels assigned. Viewed as a whole, 
the factor names appear consistent with the 
description of the OCD director's major re- 
sponsibilities and duties, One of the purposes 
of the present study was to investigate the 
utility of the multidimensional scaling ana- 
lytic model for obtaining a parsimonious 
description of an administrative job, with 
specific reference to the job of the OCD di- 
rector. The obtained results support a con- 
tention that the model appears applicable in 
these circumstances. The contention is sup- 
ported on the basis of both the qualitative and 
the quantitative data. 

From the qualitative point of view it is 
evident that the factors appear meaningful, 
“Meaningfulness” is probably a principal 
criterion to employ when a Statistical-mathe- 
matical model is superimposed on sensory or 
qualitative attributes, Likewise, the factors 
are parsimonious. The 34 task functions, 
representing a complex Psychological space, 
were reduced to four orthogonal factors which 
now may be more easily defined operationally. 

From the quantitative Point of view one 
may look to the “neatness” of the factor- 
analytic results. With Tespect to the factor 
matrix, there was a clean break after Factor 
4. Moreover, the symmetry of the unrotated 
matrix, after the break, was quite acceptable. 
In addition the factors appear more or less 
consistent with the building System-operating 
System inherent in the OCD developmental 
cycle. Specifically, Factor 2 seemed to split 
along the lines of routine planning and emer- 
gency planning, Similarl 
lates to building- 
4 seemed conce: 


CONCLUSIONS 

The obtained results no 
for describing the job fu 
director, but can serye 
purposes. The factors m 
as a basis for developing 


t only form а basis 
nctions of the OCD 
a number of other 
ay now be employed 
unidimensional Scales 
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which can be used as the basis for Won 
ance evaluation (cf. Schultz & Siegel, 1 i 
Having determined, for example, о. 
source evaluation" is an important di ed 
sion of the director's duties, petu 
measures relating to an individual's a 
performance can be constructed. mM 
Similarly, selection measures an rane 
programs may be built along the sa ca 
dimensions. Thus, the personnel ШО о, 
may be developed in an integrated sre 
each aspect of which is based on a Ше 
and firm foundation. Each element caben 
System would be based on common d 
sions and be logically interrelated. № worm 
the task functions involved in т "and 
may now be psychometrically scale dos 
Some dimension such as importance elite 
ing the overall OCD mission. The de ne 
ment of a series of Factor X eap 
matrices might form the basis for an odë 
step in the development of a descripti ane 
of the director’s job. Such a model cou -— 
an important function in the developn 
performance evaluative measures. 
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UNDERLYING DIMENSIONS OF PERSONAL BACK- 
GROUND DATA AND THEIR RELATIONSHIP 
TO OCCUPATIONAL CLASSIFICATION 


MELANY E. BAEHR axb GLENN B. WILLIAMS 


Industrial Relations Center, University of Chicago 


In order to identify underlying dimensions of personal background data, 3 
successive factor analyses were performed on the responses of a vocationally 
heterogeneous sample oí 680 male Ss to a wide spectrum of commonly used 
personal-background-data items. Using the final factoring, an analysis of 
variance of scores derived from 15 interpretable 1st-order factors across 10 
occupational groups showed significant F ratios (р < .001) for virtually all 
factors, A 2nd-order factor analysis yielded 5 uncorrelated factors, thought 
to represent broad behavior patterns associated with the needs and achieve- 
ments of individuals. The study indicates relationships between the identified 
dimensions and occupational classification and provides a framework for future 
investigations of the dynamic relationships between biographical dimensions 


and occupational success. 


Personal background data are often used in 
Occupational selection and in vocational ad- 
Visement and placement largely because this 
Information is relatively easily obtained, is 
Senerally less subject to distortion than re- 
Sponses to personality questionnaires, and has 
боой face validity since a great deal of re- 
Search indicates that what a person has 
achieved or failed to achieve in the past will, 
With some degree of assurance, indicate what 

€ may achieve in the future. Another ad- 
Vantage of these data is their contribution to 
Multiple correlations of psychological test 
batteries against an empirical criterion since 
ey are relatively independent of skill and 
ability measures which, themselves, generally 
Show moderate to high intercorrelations. 

When rigorous psychometric procedures are 
Used to investigate the predictive validity of 
Personal-history items, the original data are 
Senerally quantified and obtained from stand- 
м biographical questionnaires or applica- 
‘on blanks, By far the most common ap- 
roach has been to identify items which are 
Valid predictors for specific criteria within a 
Siven occupational group. These items are 
si en combined without weighting or are as- 

8ned differential weights in the calculation 

a composite “score”? for the questionnaire 
a whole. Scores obtained from these pro- 
“dures have been cross-validated for occupa- 
lons ranging from seasonal employees (Dun- 


nette & Maetzold, 1955), through production 
supervisors (Lockwood & Parsons, 1960), 
clerical workers (Guthrie, 1956; Minor, 
1958), various sales personnel (Goldsmith, 
1922; Mosel & Wade, 1951), to managerial 
personnel (Scollay, 1956) and research scien- 
tists and engineers (Buel, 1965; Smith, Al- 
bright, & Glennon, 1961). A considerable 
body of work has also been done in this area 
for personnel in the armed services (Elliot, 
1960; Levine & Zachert, 1951; Seaquist, 
Barry, & Sells, 1956). 

While it has been demonstrated that this 
usage of background data has often increased 
the predictive effectiveness of test batteries, 
it has been justifiably criticized on the basis 
of its empiricism and failure to relate obtained 
results to meaningful dimensions of behavior. 
This problem has been met by Levine and 
Zachert (1951) who subjectively classified 
items in terms of content. The validity of each 
item in the content category was then deter- 
mined and if an acceptably large number of 
items showed significant relationships with 
the criterion, the content category was re- 
tained and the items differentially weighted. 
A more theoretical approach was taken by 
Super (1960) who postulated five major cate- 
gories of experience which could be measured 
through biographical data. 

In their study of research scientists, Mor- 
rison, Owens, Glennon, and Albright (1962) 
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met the criticism of empiricism by a factor 
analysis of life-history items which had been 
previously validated against three perform- 
ance criteria. Their twin objectives were a 
better comprehension of the personal char- 
acteristics represented by the items and the 
use of the identified dimensions to examine 
the differential profiles of three criterion 
groups. Five factors were identified which ac- 
counted for 23% of the variance. The rather 
small proportion of variance accounted for, in 
the view of the authors, confirms the expecta- 
tion that life-history data would reveal con- 
siderable uniqueness. While this "in-depth? 
study did generate factors which distinguished 
between different behavior patterns within the 
research-scientist occupational classification, 
the factors could not be expected to be of 
sufficient generality for use in the broader 
areas of counseling and placement or to con- 
tribute to an understanding of the dynamic 
relationships between personal background 
and general occupational success. 

The approach followed in the present study 
was a factor analysis of the responses of a 
heterogeneous occupational sample to a wide 
variety of quantifiable personal-background- 
data items in multiple-choice format, The 
hope was that the resulting factors would be 
meaningful and significant background param- 


eters for the general, male, employed popula- 
tion. 


МЕтнор 
Variables 


a patterned 


biographical 
tr, Baehr, & Burns, 1961). Thirteen 


the Personal History Index (Baehr, Burns, & Mc- 
Murry, 1963). 
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Subjects 


A total of 680 male Ss responded to. the peces 
version of the questionnaire. The vocational he p 
geneity of the sample may be gauged кош. 
brief descriptions of the subgroups which follo ашу 

Professionals (s = 93). The Ss consisted n in in 
of chemical engineers or chemists engaged ей е 
product development or research. Most were =з or 
late 30s, held a bachelor's degree in Fue 5,000 
engineering, and earned between $11,000 and $15j 
a year. 

Middle and Upper Executives (n = 74). ee 
ranged from third-level supervisors to top ea eld a 
Most were іп their early or middle Sos, = ad- 
bachelor’s degree in the arts, sciences, or ee 000 
ministration, and earned between $11,000 апа $15; 

a year. - gely 

Junior Executives (n = 26). These Ss were sce 
engaged in administrative or higher-level hold a 
Work. Most were in their middle 305, p andi 
bachelor's degree, and earned between $6,000 а 
$10,000 a year, р n- 

District Sales Managers (л = 128). This е 
sisted entirely of managers in the insurance ? middle 
Most held a bachelor’s degree, were in tn 15,000 a 
or late 305, and earned approximately $15; 
year, А of 

Salesmen (п = 128). This subgroup agen 
insurance and paper-forms salesmen. The m and 
of both groups had from 1 to 4 yr. of Eo ania 
were in their early to middle 40s. Their 510,000 
salary ranges were, respectively, $6,000 to $19; 
and $11,000 to $15,000. А оѓ 

Foremen (л = $1), This subgroup е a 
first-line Supervisors from metal, hen high 
petroleum industries, Most had complete arnel 
school, were in their middle to late 30s, and € 
between $6,000 and $10,000 a year. " d both 

Hourly (и = 79). This subgroup кеш cnc 
skilled and semiskilled hourly personnel fron skilled 
neering and manufacturing plants. Most d de semi- 
Workers had completed high school while i The 
skilled group averaged 9-11 yr. of schoo EUM t 
majority of both groups were in their d $10,00 
middle 40s and earned between $6,000 an 
a year. re classi- 

Auditor Supervisors (л = 61). These Ss ie en 
fied by civil service as either GS-13 or GS: degrees 
were between 45 and 50, held a bachelors ee, 
and earned between $11,000 and $15,000 а У group 

School Administrators (п = 82). This dors an 
contained both lower-level school adii The 
teachers aiming for an administrative po in age 
administrators held master's degrees, xn 000 and 
from 30 to 34 yr, and earned between $6; 
$10,000 a year, is grouP 

Community School Directors (л = 45). This Е О” 


0 А ools 
consisted of directors in the community sch a 


es 
grams. The majority held bachelor's. ee liberal 
many held master's degrees in education ual in^ 


arts. Ages ranged from 25 to 29 yr. and ann 
come from $6,000 to $10,000. 


PERSONAL DATA AND OCCUPATIONAL CLASSIFICATION 


Procedure 


The procedures described here were implemented 
through use of an IBM 7094 electronic computer. 
The estimated means, variances, and kurtosis of the 
distribution of the responses of the total sample 
ОЁ 680 Ss were obtained for each of the 150 items. 
Item responses were dichotomized and the matrix of 
tetrachoric covariances calculated. Since the available 
factoring program would accept a maximum of 125 
Variables, a “goodness of variable program”? was 
used to identify the least promising variables. As a 
Tesult, 26 variables were excluded from the first 
analysis. For the sake of completeness of the 
analysis of the data, however, these variables were 
included in two subsequent analyses as will be de- 
Sctibed in the Results section. 
tai n cach analysis, a principal axis solution was ob- 
a With subsequent rotation of accepted factors 
crite ћовопа] simple structure using the equamax 
ЖҮ erion (Saunders, 1962) and to oblique simple 

Tucture using the promax criterion (Hendriksen & 
White, 1964). The correlations between the oblique 
Actor axes were obtained for the third and final 
actoring and a second-order analysis performed 
ae the same factoring and rotational procedures 

^t were employed in the first-order analyses. 
dis he ability of the first-order oblique factors to 
i criminate between the occupational groups was 
“Vestigated through an analysis of variance of both 

© calculated beta-weight and the unit-weight factor 
ae Across the 10 occupational groups — a 
in y € sample. This was followed by а t-test anal ysis 
ең each occupational group was compared with 

TY other for each of the factor scores. . 

Шау, the factors were examined according to 
um following four criteria: clearness of (шоп 
ln Structure, number of items with ril 
ебу 55 Which defined the factor, the correlations 
fares the respective beta-weight and эш 
со Or scores, and the Kuder-Richardson reliability 

°Шсїетз, in order to make a tentative „selection 
factors with the most potential for operational use. 


Fact RESULTS 
or Analyses 

The successive first-order factor analyses 
Provided a content analysis of the items with 
Sect to duplication and relevance for the 
omain being studied. The first analysis, 
ased on 124 items, yielded 22 factors. The 
3Slority of the rotated factors were inter- 
retable but the structure was marred by an 
esirably large number of items with low 
insignificant factor loadings and the ap- 
au Тапсе of two doublets and а triplet. The 
ter were clearly due to duplication of items 
Ny à i Saunders 
for ee authors are indebted to David ue aem 
ang Dnstructive criticism of the experimen a g 


Or use of hi rograms. 
2 of his computer P S 
D. R, Saunders, personal communication, 1965. 
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and were of no interpretative significance. 
Only one item from each of these factors was 
retained in subsequent analyses. 

In all, 29 items were dropped from the 
second analysis because of duplication or 
insignificant loadings, and the 26 items which 
had not yet contributed to an analysis were 
substituted, making a total of 121 items. 
The second analysis yielded 21 factors. An 
examination of the oblique rotational solu- 
tion showed that the major factors were rela- 
tively unchanged but there had been some 
sifting and sorting of items for factors which 
accounted for lesser percentages of variance. 
In general, the 26 items originally excluded on 
the basis of the “goodness of variable cri- 
terion” made very little contribution to the 
factorial structure. 

In the third and final analysis, after the 
exclusion of all items on the basis of duplica- 
tion, ambiguity, or nonrelevance, 105 items 
remained and were utilized. These items were 
composed of the 78 which had shown clearest 
factor loadings in either or both the previous 
analyses and an additional 27 items of rather 
doubtful status which were carried on the 
Dwyer (1937) extension procedure. These 
latter items did not affect the factorial struc- 
ture but their loadings on the identified fac- 
tors were calculated. Use of this procedure al- 
lowed the authors to be sure that potentially 
useful items were not excluded while main- 
taining clear factorial structure. 

The final factoring yielded 15 factors which 
accounted for 66.6% of the correlation and 
43.3% of the variance. In the oblique rotated 
matrix? the items are identified by number, 
both for the 1963 edition and the revised 
version of the Personal History Index (Baehr, 
Burns, & McMurry, 1965). 

The contribution of the items carried on 
the Dwyer extension procedure is minimal. 
Half of them show no loading greater than 
.20, and only two items have loadings as great 
as .30. 


Interpretation of the First-Order Factors 


The interpretations are given for the ob- 
lique rotational solution. The factors did not 

3 This table of results is available from the In- 
dustrial Relations Center, University of Chicago, 
upon request. 
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appear in the order 
been renumbered for 
tation. 

Factor 1 (School Achievement). The four 
highest loadings were on items which indicated 
that the school years were felt to be successful 
and stimulating, that the ranking in high 
School was in the top quarter, and that many 
school subjects were liked and few disliked. It 
was defined as: “Academic achievement, par- 
ticularly in high school, but also, where 
applicable, at college. A general liking for, and 
adjustment to, the school environment.” 

Factor 2 (Higher Educational Achieve- 
ment). The major loadings were on items 
which indicated that a bachelor’s degree was 
held, that the respondent was 22 yr. or older 
before he got his first real job or one on 
which he was financially dependent, that he 
was 26 yr. or older before his first marriage or 
before his first child was born, and that his 
Present annual earnings were over $10,000. 
The factor was defined as: “Special or tech- 
nical accomplishment and qualification result- 
ing in a relatively late vocational start and 
late assumption of family responsibilities. 
This pattern is characterized by eventual oc- 
cupational and financial achievement.” 

Factor 3 (Drive). The five highest loadings 
were on items which indicated that the re- 
three or more com- 
€ or more full-time 
the work of others 


given below but have 
convenience in presen- 


Participa- 
actor was 
h contact 
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with others as shown by membership вн. 
interpersonal activity in organizations an 
an interest in influencing others through com- 
munity and social activities. A high score 
suggests active participation and розы 
leadership in personal contact situations O 
various types." 
айога (Financial Responsibility). Seven 
out of eight of the loadings were on i 
dealing with present financial status p 
handling of finances. The respondent га 
dicated that present total assets, annual eari 4 
ings, salary increases, and percentage of va 
come saved were relatively high while Tonin y 
credit payments were less than 10% of a 
come. He had owned stock in a company The 
carried $30,000 or more life insurance. 
factor was defined as: “Ability to er 
personal economy of defined proportions 
earn, invest, save, and accumulate.” _ lity) 
Factor 6 (Early Family Да} и, 
The major loadings were on items ipei ‘a 
dicated that the respondent was 25 e en 
younger when he was first married and "ds 
his first child was born. He currently = 
two or more children, his wife did not on 
and he felt that his major panca ape 
outside of work was in family activities. 
factor was defined as: “Early marriage 6 
establishment of а family, with (е ee 
ordinarily being the sole provider. Deni "s 
Strated achievement in handling msc 
financial affairs. Outside the work situn | 
the greatest interest is in family дЕн, a, 
Factor 7 (Parental Family A in- 
The major loadings were on items whic e 7 
dicated that the respondent felt — was 
child, he had a happy home life and ities 
often included in the leisure-time sinis 
of the parents. He conferred v um 
about occupational choice and, in his help 
usually went to his father or mother at as: 
With a problem. The factor was ai 
"Development of realistic and Lorie d 
attitudes in the early family pue en 
This includes relationships between e an 
between parents, and between the chi 
the parents.” four 
Factor 8 (Situational Stability). Та in- 
highest loadings were on items whic e 
dicated that the respondent was 40 Pd je 
older, had worked 10 yr. or more for one 
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Dany, and did not think that his peak per- 
formance was some time in the future. He 
had lived 5 yr. or more at his last previous 
address. This factor was defined as: “Estab- 
lished security and stability in the work situa- 
tion, resulting from past history of good per- 
formance. Presently more concerned with the 
Maintenance of what has been achieved than 
With plans for improvement or development.” 
‚ Factor 9 (School Activities). Major load- 
1105 were on items which indicated that the 
respondent participated in four or more high 
school activities, had three or more strong 
Outside" interests while in high school, and 
Spent 10 or more hours a week on high school 
athletics, A minor loading indicated that he 
ranked, scholastically, in the top quarter of 
15 high school class. The factor was defined 
= "Major emphasis on active participation 
? athletic and extracurricular social activities 
high school but also indication of good 
academic achievement.” 
actor 10 (Pro fessional-Successful Parents). 
2e major loadings were on items which in- 
lated that the father at least graduated 
ties high school, and that his principal ос- 
Pation was professional or managerial, or 
s he was self-employed, and that the re- 
Pondent felt that the father was a successful 
pert The factor was defined as: ^A 
ce cta background characterized by a suc- 
o Sful father, either self-employed or in one 
е professions, and by material comfort 
bo happy home life.” : 
sis actor 11 (Educational-Vocational Con- 
с tency), This factor was essentially a triplet 
Posed of three items dealing with the 
tionship between educational specialization 
dim, Pe job held, and with similarities m 
the rent full-time jobs that had been held by 
е respondent. Tt was defined аз: “А prefer- 
for Occupations which are highly related 
Similar) and in line with educational 
pests and training." . . 
fi rU 12 (Vocational Decisiveness). п 
thr = had only four sizable loadings, t 
ings highest of which were on items which 
gp ied that the respondent had not ipe 
Sing Of specialization or vocational p ans 
cisiy, high school. It was defined as: De- 
ful ness in choosing an occupation, purpose- 
“SS in achieving the necessary qualifica- 


and 


Tela. 
and 


(or 
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tions, followed by an early start in the chosen 
occupation.” 

Factor 13 (Vocational Satisfaction). The 
major loadings were on items which indicate 
that the respondent would follow the same 
occupational route if he had it to do over 
again, that he would not change his area of 
specialization, and that his parents felt that 
he should choose the occupation which he liked 
best. There were a number of minor loadings 
which suggested satisfaction but also sug- 
gested rather limited goals. The factor was 
defined as: “Satisfaction with occupational 
choice and the expectation that peak per- 
formance will be some time in the future. 
There is, however, no evidence of consistency 
of application or of drive to achieve high 
standards of performance.” 

Factor 14 (Selling Experience). The three 
or four major loadings of this factor were on 
items which dealt with experience in buying 
and selling. There were a string of minor 
loadings on items which could be construed 
as being compatible with the background and 
activities of a salesman. However, the struc- 
ture was not clear, and the factor, by defini- 
tion, would discriminate between sales and 
other vocational groups. It was therefore not 
regarded as being of intrinsic interpretative 
significance. It was defined as: “Evidence of 
various kinds of selling experience, including 
door-to-door selling and transactions in real 
estate.” 

Factor 15 (General Health). All five items 
which loaded on this factor dealt with free- 
dom from physical ailments and serious ill- 
nesses. It was defined as: “Generally better 
than average health over an extended period 
(child, adolescent, and adult). General free- 
dom from physical ailments and from lost 


work time due to illness.” 


Interpretation of the Second-Order Factors 


The correlations between the 15 primary 
factors are given in Table 1. The orthogonal 
and oblique rotational solutions for the fac- 
tors derived from this matrix are given in 
Table 2. Loadings of .30 or greater for both 
the orthogonal (equamax) and oblique (pro- 
max) rotations are italicized in Table 2 and 
interpreted below. The factor patterns were 
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TABLE 1 
CORRELATIONS BETWEEN THE 15 PnrMARY-FACTOR AXES 
14 15 
Factor 1 2 3 4 5, 6 7 8 9 10 11 12 13 m m 
13 E = 
2 d 33 001 —.05 —.21 —.09 10 29 19 13 ОУ cs 
› 44 5 18 13 27 07 07 —20 —01 130 25 X зш EH -3 
3 26 18 23 20 20 —08 о оз  . 08 ar Че 4 ài 
4 23 12 23 07 06 лі —36 203 21 28 m 20 юв —01 
5 33 27 320 207 3; —о4 12 —13 24 02 E 05 a; 08 
6 01 07 20 106 37 —05 01 A3 20  —.05 24 Жу бо ii 
7 —.05 07 —08 .11 —204 —05 05 ai 20—01 S1 —12 -—24 E 
8 —21 —20 04 —36 12 01 05 -23 -21 =22 =) 7 by. 04 45 
9 =.09 —01 .05 03—13 43 14+ —23 EE qn cu "s 129 06 
10 10 130 44 21 24 20 20 —21 43 07 a 09 102 —.0 
11 29 25 106 128 02 —.05 —01 —22 02 07 23 i5 u2 —.01 
12 19 22 EN 251. 14 14 231 —21 —07 28 23 —10 12 
13 A3 17 —18 20 08 07 22 —12 .07 18 09 d3 ag ‘os 
14 08 109 28 09 .08 17 —09 —2 04 29 02 42 йр 10: 
15 —11 -—i13 —25 07 —.01 —03 41 —0%6 205 06 —.06 —01 12 


virtually identical for the two solutions and 
led to the same factor interpretations. 
Factor A (Educational Background and 
Achievement). The three major positive load- 
ings were on the primaries School Achieve- 
ment, Higher Educational Achievement, and 
Educational-Vocational Consistency. There 
was a lesser negative loading on Stability. 
The factor was defined as: “Educational 
achievement in childhood and adult life and 
its application to real-life situations,” 
Factor B (Upward Mobility and Drive). 
The three highest loadings were a Positive on 


tional Satisfaction and Parental ay “A 
justment. The combination of a positive d 
ing on the Drive factor and a negative pet 
ing on the Vocational Satisfaction factor ave 
to be expected in terms of their respec ен 
definitions. Tt has been pointed out that is 
Vocational Satisfaction factor hints of io 

faction achieved rather as a result of yc 
goals than of special application or тае 
The negative association between the e 
and Parental Family Adjustment аре 
predicted by one of the psychologists A at 
ated with the study. McMurry * claims 


1 5 P. ый 1965. 
the primary Drive, and negatives on Voca- * R. N. McMurry, personal communication, 
TABLE 2 
ORTHOGONAL AND OBLIQUE ROTATED MATRICES FOR THE 5 SECOND-ORDER FACTORS 
Orthogonal matrix Oblique matrix 
Primary 
factor Second-order factors Second-order factors 
E 
A B c D E A B © à zd 
NN 
Eu НЕ 0 
1 Z3 | dii 15 11 06 so” | m 00 Ar ыш 
3 57 04 10 25 | —06 53 06 | —.05 2 04 
1 09 | —52 32 35 00 | —01 | —sr 28 25 | 06 
: 19 07 69 40 | —17 .06 04 oo | =Ш 20 
5 B. 5! ae | р = —.05 
7 ~.03 | —05 05 51 | —08 | —06 | —o4 | —01 30 07 
07 bI Ж e 0 | —10 | 40} 49 | 0) ‘ss 
8 —32| —03 | = 21 17 | | —s| о | —06 SEE 
9 = el) ЕЕ —06 | 08 | —.04 | aa 
10 42| “19 | 3 46 | —33 ‘08 18 08 45 | 08 
1 8| їз 33 | 01 47 | =й | "ue 
12 14 10 69 18 | —.03 00 09 61 n 00 
13 21 ж | 4l |o 20 49 04 е. 
14 .01 —.26 10 28 | 40 | ср —27 `03 25 | "iH 
15 А ей | —09| 29 | —o | —03 


Note.—Loadings of .30 or greater are italicized, 
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over the years of his consulting experience in 
industrial organizations, he has found that 
happy and adjusted parental family situations 
Often produce pleasant or easy-going people 
but do not appear to generate the personal 
Striving and aggressiveness necessary for up- 
ward mobility in the line management hier- 
archy. The factor was defined as: “Inner 
drive to be outstanding in performance, to 
set high goals, and to move upward in the 
organizational hierarchy.” 

Factor C (Personal-Social Leadership). The 
three highest loadings were on the primaries 
^adership and Group Participation, Voca- 
tional Decisiveness, and Drive. The common 
element indicated by these loadings appeared 
to be the action-oriented decisiveness and 
Personal leadership in the social and occupa- 
“onal environment. The factor was defined 
as: "Participation and personal leadership in 
Social situations and occupational environ- 
Ments,” 

Factor D (Financial Achievement and 

ackground), The two major loadings were 

n the primaries Financial Responsibility and 
i arly Family Responsibility with lesser load- 
ngs on Professional-Successful Parents and 

tive, The factor was defined as: “High 
Achievement and responsible management of 
“Dances and early marriage with sole respon- 
Sibility for family support, associated with a 
Parental family background of affluence and 
Success.» ы 

Factor E, (Stability and Status Quo Orien- 
ов), The major loading was on the sitim- 
ta Stability factor which indicated vie - 
ies Security and concern over p ea 
restr of what had been achieved. The г =a 
s, active flavor of this factor was empha 
чад by the negative loadings on Selling Ex- 
Perience, School Activities, and Professional- 
> Wcessful Parents, that is, primaries which 
dicated mobility and action. The factor was 
a hed as: “Establishment and maintenance 
a ability in the occupational and heme e 
side ments associated with avoidance of OU 

€ activities.” 

Ort Clear structure was obtained for п 
u hogonal rotation, and, as may be expecte 
ader these circumstances, the correlations 


tween the oblique second-order factors were 


TABLE 3 


CORRELATIONS BETWEEN THE OBLIQUE 
SECOND-ORDER FACTOR AXES 


| А B d: D E 
А —.06 39 13 —.01 
B —.06 .06 —.07 =\12 
С .39 .06 27 —29 
D 13 —.07 #1 zx 10 
E —.01 —.2 —.29 —.10 


quite low. These correlations are given in 
Table 3. 


Analysis of Variance 


An analysis of variance was undertaken 
using both the derived beta-weight and the 
unit-weight scores for the 15 oblique first- 
order factors across the 10 occupational 
groups. Examination of Table 4 will show that 
virtually all factors discriminated between the 
occupational groups at the .001 level of con- 
fidence or better, though some of the factors 
were clearly more efficient in this respect than 
others. The discriminative power of the fac- 
tors was further investigated by a complete 
series of £ tests of significance of the differ- 
ences between the mean unit-weight factor 
scores for each of the 45 possible comparisons 
of pairs of occupational groups.? 

Each factor showed some differences for 
pairs of occupational groups significant at the 
.05 level or better. These differences range 
from 8 for the Parental Family Adjustment 
factor to 37 out of a maximum of 45 for the 
Financial Responsibility factor, with a mean 
of 25.8 per factor. Each pair of occupational 
groups showed some differences at the .05 
level or better ranging from 3 for the com- 
parison between district sales managers and 
other line executives to 14 out of a maximum 
of 15 between sales and hourly personnel with 
а mean of 8.6 significant differences рег 
occupational comparison. 


Identification of Factors with Most Potential 
for Operational Use 
Although the beta- and unit-weight scores 
for the 15 first-order factors will be routinely 
5 This table of results is available from the In- 
dustrial Relations Center, University of Chicago, 
upon request. 
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TABLE 4 


ANALYSIS OF VARIANCE FOR THE UNIT- AND BETA- 
WEIGHT SCORES FOR THE 15 OBLIQUE FIRST- 
ORDER Factors across 10 OCCUPATIONAL 
Groups 


Beta-weight scores Unit-weight scores 
Factor | 
Е r F | r 

T Iouis 27 13:25 | .39 
2 18.08** At 45.08** 61 
3 4.16** 23 6.26** 28 
4 12:53** .38 26.30** 51 
5 18.42** 45 43.25** :61 
б 5.28** 26 28.37** 53 
7 141 14 2.80* 19 
8 16.52** 43 157.39** .82 
9 3.24* 20 14.55** 40 
10 5.47** 26 13.68** 39 
11 8.08** :31 20.40** 46 
12 4.64** 24 4.60** 24 
13 3.85** 22 29.78** 53 
14 28.82** 53 27.88** .52 
15 3.07* 20 5.24** .26 


calculated for other 
Some years to come, 
directed toward the 
factors which seem to 
for operational use in 


research purposes for 
attention will also be 
identification of those 
offer the most potential 
terms of their reliability 
and construct validity. These latter factors 
will be subject to Specific research studies in 
organizational settings, 

In a practical Situation, the use of beta- 
Weight scores is extremely cumbersome if 


Ркорист-Момхт INTERCORREL 
ORDER OBLIQUE Е ACTORS 
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not unfeasible when computer facilities e 
not available. The use of unit-weight pon 
immediately raises questions concerning E 
number of items assigned to each factor, a 
correlations between the respective ac 
weight and beta-weight factor scores, an re 
intercorrelations for the unit-weight sco 
This information is given in Table 5. » ей 
The internal-consistency ug u^ don 
mates obtained by applying the (nes 
Richardson formulas to the unit-weight im 
scores are given in Table 6. The kar 
up the deficiencies of factors such as Арт 
is defined by а small number of — e ^ 
of 13 and 14, where the factorial € es 
unclear. Although these latter factors pom 
sizable number of items allocated с. er 
only three or four items per factor hav d 
ings of .30 or larger with the remaining 
ings being indeterminate. І a 
The ability of the unit-weight ms ene 
to discriminate between occupationa j e 
was discussed in connection with Tar "we 
t-test analysis. In this connection E 
interest to note that although € rd 
(General Health) has a clear factoria wet 
ture with at least a тёбеге mura vala 
items with significant loadings, it uie 
tively low reliability, and is relative does 
in its power to discriminate bewen сін 
tional groups. The final selection o айпа 
must await the results of studies ee 
the factor scores to successful We basis 
within an occupational group. On sent; ї 
of presently available evidence, hov 


TABLE 5 


n : : FIRST- 
ATIONS OF THE UNIT-WEIGHT SCORES FOR THE 15 F 


AND CORRELATIONS BETWEEN THE RESPECTIVE 
BETA- AND Unit-Weicut Е 


ACTOR Scores (8-u) — 
E : ^ 
Factor 1 2 " и 
3 4 5 6 7 8 9 10 11 12 m 4 
= 1 
1 —10 04 —.07 EN TI 04 = 19 10 03 = 
2 —.10 LES E" M. KH пу 34 25 101 53 7920 
H a =o э О чу = 07 03 —071 -—12 08 — Q3 
| s a 05 101 T 5а ло 6 03 i! 206 
5 = е M M Ss o do 4 9 0! 06 
6 04 05 07 01 35 101 108 105 106  —.03 02 „12 
1 $5 2 07 o3 =й oo ^7 —06 -11 —02 125 14 738 
8 М2 S эс m —.14 04 07 —19 =з 206 107 по 205 
б 09 9 07 5а UM 08 06 i 31 дё ew ло iol 
10 +09 22 — 193 ло 107 © 1 34 Н 102 RT 103 101 
5 10 б de wo S 12 оз 17 -M @ 
12 us 3 г з 00 —03 225 —02 45 47 16 ‘02 
13 d» 3 c] Mg 96 —06 з 29 а. 01 
14 —.04 03 53 08 01 21 02 10 10 Q3 = 1б 02 Р 
15 02 —.10  —.03 20 —0оз 06 ‘06 19 фо 8 01 `0 n 
P К 
В-и 87 B3 86 7 83 .88 90 76 72 80 87 12 ae 
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would seem that the first eight factors pre- 
sented in the interpretations offer the most 
potential for operational use. 


DISCUSSION 


The vast bulk of previous research in- 
vestigating the validity of quantifiable items 
of background data in predicting occupational 
success has taken the approach of determining 
the extent to which individual items could 
differentiate between successful and unsuccess- 
ful performance within a particular occupa- 
tional group and the subsequent construction 
of an index based on weighted or unweighted 
responses to the discriminating items. This 
research has rightly been criticized on the 
Srounds of empiricism, its failure to provide 
any explanation as to why certain background 
items should be combined or be predictive, 
and because of its failure to shed any light 
9^ the dynamic relationships between early 

Ome and school environments and eventual 
Performance in an occupation. 

The present research followed the approach 

first attempting to identify and define some 

the significant underlying dimensions of 
ackground data. This was implemented 

Tough successive factor analyses of responses 
у occupationally heterogeneous sample 
| male employees to а wide spectrum 0 
ackground-data items derived from the 

me, school, college, and work environments. 
he final factoring employed the principal 
axis solution and yielded 15 factors which 
accounted for 66.6% of the correlation and 

3% of the variance. The factors were 
rotated both to orthogonal simple structure 
using the equamax criterion (Saunders, 1962) 

T8. & oblique simple structure using the 
Promax criterion (Hendriksen & White, 1964). 

15 factors from both solutions were 1п- 
a, Pretable but the structure was clearer for 

Oblique solution. . 
Second-order analysis of the correlations 
vi ееп the oblique primary-factor ie 
aud five factors with very similar factoria 
тс itus for both the orthogonal and oblique 
фы tonal solutions. This would seem to in- 

‘cate that, in the second order, the back- 
Rrounq.data factors were largely uncorrelated. 
1€ combinations of primaries represented in 


betyy 


TABLE 6 


Kuper-RIcHARDSON RELIABILITY COEFFICIENTS 
FOR THE Uxir-WricHT Factor SCORES 


Reliability 
Fator | xe | Ме | oxy с. 
number items 
| K-R 8| K-R 20 к-к 21 
1 2.90 6 | 164) 71 57 53 
2 5.34| 11 | 240} .68 .60 .58 
3 442 8 |241| .75 .65 .64 
4 3.43 8 12.07 | .73 64 .62 
5 143 8 |222| .77 .69 .68 
6 7.78| 13 |280] .77 42 :65 
7 6.83] 10 |218| .73 .65 .60 
8 5.16 9 | 2.47 82 ‚76 72 
9 3.42 | 7 2.07 AD 64 .55 
10 3.27 7 |1,78) .68 55 .52 
11 2.90 + 1.64| .87 54 .52 
12 2.21 5 |1.36| .66 43 ESI 
13 5.91 12 2.24| .62 51 ES 
14 541| 10 |2.01| .60 47 43 
15 2.76 5 |131| .66 43 34 
I | 


the second-order factor were logically and 
theoretically acceptable. 

An analysis of variance utilizing both unit- 
weight and beta-weight scores for the oblique 
primary factors across the 10 occupational 
groups comprising the sample indicated that 
virtually all factors would discriminate be- 
tween the occupational groups at the .05 
level of confidence and the majority of them 
at the .001 level or better. The discriminatory 
ability of the factors was investigated through 
the calculation of the significance of the dif- 
ferences between the mean unit-weight factor 
scores for each of the 45 possible pairs of oc- 
cupational groups. The results indicated that 
each pair of occupational groups showed some 
differences significant at the .05 level of con- 
fidence or better and, conversely, that each 
factor showed some significant differences for 
pairs of occupational groups. 

A tentative selection was made of eight 
factors which seemed to have the most po- 
tential for operational use on the basis of 
clearness of factor definitions, the number 
of items defining the factor, the correlation 
between respective unit-weight and beta- 
weight scores, and the Kuder-Richardson 
reliability coefficients. Attention should also 
be directed toward the second-order factors 
which had the advantage of being uncorrelated 
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and of seeming to represent five broad be- 
havior patterns identified as: 


А. Educational Background and Achieve- 
ment 

B. Upward Mobility and Drive 

C. Personal-Social Leadership 

D. Financial Achievement and Background 

E. Stability and Status Quo Orientation 


The research has provided a framework for 
the interpretation and examination of some 
significant behavioral dimensions inherent in 
background-data items for the occupations 
represented in the sample. It has shown that 
these dimensions as represented by the pri- 
mary factors will differentiate between Ss in 
different occupational groups. Since the cor- 
relation between background-data scores and 
the skill and ability measures which tradi- 
tionally discriminate between occupational 
groups has generally been found to be low, 
the tentative conclusion may be drawn that 
the background-data scores are intrinsically 
discriminative for Occupational classification. 

The extent to which the background-data 
factors will be predictive of successful per- 
formance within an Occupational group can 
be investigated by multiple-regression analyses 
against selected empirical criteria. Such in- 
vestigations may well lead to the identification 
of characteristic background profiles for suc- 


cessful performers in different occupational 
groups, 
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RESPONSE TENDENCIES IN THE SVIB: 


THE POPULAR, THE RARE, AND. THE 
SOCIALLY DESIRABLE 


DONALD G. ZYTOWSKI лхо JAMES A. WALSH 


Iowa State University 


A number of response sets: popular, rare, socially desirable, liking, and in- 


difference were exa 
social d 


mined for their correlations with each other and personality 
esirability (SD), and for their influence on the scales of the SVIB-M. 


It was found that the scale of SD formed from personality items is inde- 


pendent of socially desirable in 
freely from item probability of 
the SVIB is scored vary 
The significance of these fin 
discussed. 


Inventories of affective responses (interest, 
attitude, and personality) appear to be sus- 
Ceptible in varying amounts to a variety of 
response tendencies. A number have been 
identified: social desirability (SD), tenden- 
Cles to avoid or endorse extreme statements, 
acquiescence, and the like. Some scales of 
Tesponse tendencies have been constructed to 
aid in the interpretation of other descriptive 
Scales, as in the case of the L, F, and K scales 
of the MMPI. Their effectiveness in achieving 
this purpose is questionable. . 

.. Of the three kinds of inventories, interest 
inventories seem to have escaped close ex- 
amination for the effects of response bias. 
nly the Kuder inventories are scored for 
the V (popular response) scale, which could 
€ said to be a measure of response tendency, 
though it is intended as an index to the 
Validity of the interest-area scales. In the 
Case of the Strong Vocational Interest Blank 
(SVIB), Filbeck and Callis (1961) have con- 
Structed a V scale (using rare responses) after 
the fashion of Kuder. Although they cor- 
related the V scale with the occupational 
Scales of the SVIB, it was not conceived as an 
Opportunity to assess the contribution of а 
tendency to elect unpopular responses to the 
Occupational scales. Berdie (1943) has in- 
Vestigated the effects of responding exclusively 
in terms of like (L), indifferent (1), or dis- 
like (D) to the SVIB, by showing score pro- 
files generated from answer sheets marked 
with one response only. It is not clear how 


terest scales, and that the latter vary more 
endorsement. Certain of the scales for which 
fairly directly with 1 or more response tendencies. 
dings for interpretation of the profile sheet is 


he marked the Items 281—400, which do not 
use the LID format, and he did not analyze 
the relative contributions of each of these 
sets to the variance in the occupational scales. 

Using a different approach to the problem, 
Walsh and Keasey (1966) investigated the 
relationship of a number of personality- and 
attitude-scale response tendencies to scores 
on the SVIB. In general, their findings showed 
factors composed mainly of occupational in- 
terests as distinct from factors emerging from 
response tendencies. That is, identifiable re- 
sponse tendencies did not tend to “get 
through" to the scores on the occupational 
scales. They did find that Edwards! (1957) 
Social Desirability (SD) scale composed of 
items from personality inventories (PSD) 
had moderate positive correlations (median 
r —.27) with SVIB Group V scales. The 
tendency to describe one's self in terms of 
desirable personality attributes is positively, 
but very moderately, related to similarity 
with social service occupations among men. 
The relationship did not hold for women. 

The contrast of Walsh and Keasey's find- 
ing of response scales from items external to 
interest inventories as essentially unrelated 
to interest scores, with Berdie's (1943) and 
Filbeck and Callis’ (1961) findings that re- 
sponse sets formed from interest items do bear 
considerable influence in the occupational 
scales, raises some intriguing questions con- 
cerning the generality of response tendencies 
from one affective domain to another. Fur- 
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ther evidence of this kind exists in Taylor's 
(1961) finding of a .58 correlation between 
PSD scores and an SD scale formed exclu- 
sively of items from attitude scales. Thus the 
focus of the present investigation was to as- 
semble an SD scale composed of SVIB items, 
and to compare that scale with Edwards’ 
PSD scale and with other response tendencies 
unique to the SVIB as measured by scales 
composed of its own items. 


Construction of the Interest. Social Desira- 
bility Scale 


The construction of an SD scale from in- 
terest items was undertaken in the method 
normally employed by Edwards (1957). 
Eighty-nine volunteers from an undergraduate 
introductory class in psychology rated the 
social desirability of endorsing (responding 
“like”) all items of the 1966 revision of the 
SVIB (which includes all the items from the 
Previous version now used in the occupational 
scales). A 9-point scale was employed, rang- 
ing between “extremely socially desirable” 
and “extremely socially undesirable” with 


“neither desirable nor undesirable” at the 
center. 


The items from 281 
ceive LID res 


desirability them, much as 


Part VII, which 


Typical of items for 


which endorsement 
was regarded as very soc 


ially desirable were 
TABLE 1 


CORRELATIONS BETWEEN ITEM SDs 


ANI 
or L, I, or D RESPONSE an 

oSD| pL H | pd | x с 

SD —.35 43 | —.19 —.38 | 6.09 1.01 
o SD Edi 3a таг | “55 
pL —.47 | —.86 371 17 
P —.03 | .351 .09 
pD | | 278 | 15 
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No. 93 (Surgeon), No. 69 (Physician), and 
No. 311 (President of a society or nd 
Socially undesirable was endorsement of such 
items as No. 292 (steadiness and porma e 
of work most important), No. 393 пла 
excuses when caught in a mistake), and No. 1 
(liking to be an auto mechanic). — 
was strong on items with extreme ratings, = 
would be expected. Items on which agree 
ment concerning social desirability was ү 
were represented by No. 221 (expressing 
opinions openly) and No. 107 (Calculus). " 

Two opportunities were available to pe 
the validity of this procedure of rating in 
SD. One was to compare the SD ps 
occupations in Part I with those rated in e 
North-Hatt (1953) study of quem 
prestige. For 64 occupations, the correla " 
between the two forms of ratings x SD 
Campbell? supplied the authors wit 108 
ratings on a 5-point scale of the first чя 
items of the SVIB (occupations) given ka 
undergraduate psychology students а iuf 
University of Minnesota. The correla is 
between these ratings and the present VIR 
‘91. It is assumed that the SD ratings of S nd 
items obtained for this study are valid n 
representative of those which might be Jp 
by other populations of similar age а 
education, А а 

Correlations between item SD ratings | 
Probabilities of endorsement were compu 
and are given in Table 1. 

The correlation between index of SD pe 
probability of a “like” response for the 43. 
items common to Forms M and T-399 i: has 
Though a relationship of this тарп e by 
only the slightest possibility of occurring 7 
Chance, it does not approach E ae 
found by Edwards (1957) between 5 ality 
probability of endorsement of acris a 
items. This suggests that, on the hon be 
person is relatively free to report i the 
jects and activities he likes and dislike ^ as 
group norms of desirability of object nn ! 
activities which may exist пош 
Reports of interests are less influenced. tions: 
than endorsements of personality dee P a le 
One might hypothesize that what is bcr in 
is more independent of what is popu 


Note.—N = 288 items. 


ication 1966. 
=D, p. Campbell, personal communication; 
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interest inventories than in personality in- 
ventories. 

Of additional interest is the correlation be- 
tween L and D responses. It appears that if 
L is not employed, the response is much more 
likely to be D than I. This large negative 
Correlation between L and D also accounts 
for the similarity between the SD-L cor- 
relation and the negative SD-D one. 

Although the independence of socially 
desirable responses and most likely responses 
suggests the possibility of construction of a 
Strong type—contrasting groups—scale of 
Interest SD, a simple scale of the 20 most- 
and 20 least-desirable items was assembled 
to provide comparisons. Because of the sub- 
Stantial negative correlation between L and 
D responses, it was assumed appropriate to 
Score 1 point for liking the high SD items 
апа the same for disliking the low SD items, 
rather than to use differential positive and 
negative weights. This scale was identified 
as Interest Social Desirability No. 1 (ISD 
No. 1), 

It was further decided, for heuristic pur- 
Poses, to form another ISD scale using the 
Method of contrasting groups, as is typical of 
Strong's scales for his blank. For this purpose, 
it was necessary to employ the item SD in 
а manner which would obtain the socially 
desirable response for each item. A Strong- 
type scale was assembled as follows: items 
Were arranged serially by magnitude of SD 
rating. The series was then divided in the 
Same proportions as are given L, 1, and D 
Tesponses over all items by men in general 
(MIG), Thus for an item whose SD index 
Was in the top 38% of the series, the socially 
desirable response was taken to be L, while 
If it fell in the middle 35% the socially de- 
Sirable response was I, and in the bottom 
2895 of the SD series it was assigned D as 
the socially desirable response. For every 
Item, the response which received the greatest 
Proportion of endorsement by the MIG group 
Was labeled as the most likely response. A 
Scale was formed by assembling all the items 
Whose most desirable and most likely re- 
Sponses differed by two categories, making a 
total of 33. ISD No. 2 was scored as the 
number of endorsements of these more de- 
Sirable than likely responses. 


TABLE 2 


INTERCORRELATION MATRIX OF б RESPONSE 
TENDENCIES ON THE SVIB-M 


| 
ISD | ISD | z 
[Ке 1|ко.2| V | B oq il е 

РУР | —017|—.42| —.26| .16| .28| 29.44] 6.7 
ISD No. 1 151] os| —.03] —.21| 16.47 | 4:5 
ISD No. 2 29| —12| —16| 8.00] 3:5 
V —109| —26| 9s | 50 

. 8.95 | 32.5 
I 103.63 | 34.7 


With two forms of Interest SD scales a 
sembled, and with Filbeck and Callis’ (1961 
V scale standing for the tendency to endor: 
rare responses, it was possible to score 
number of SVIB answer sheets and correla 
the response-set scores with those normal 
provided on the SVIB profile. Walsh ar 
Keasey (1966) made the Form M answ 
sheets from their study available for this pu 
pose, providing Edwards’ PSD scores ar 
L and I response frequencies. The answ 
sheets were handscored for the new respon 
scales, and the data punched on cards f 
analysis on an IBM 360-50 computer. ( 
first interest are the intercorrelations betwee 
the response tendencies themselves. They a 
presented in Table 2. D was excluded becau: 
it is virtually the mirror image of L. 

Several observations can be made. Mo 
notable is the correlation indicating that tl 
tendency to describe one's self in socially d 
sirable personality terms (PSD) is essential 
unrelated to the tendency to endorse social! 
desirable interests. (ISD), no matter ho 
the latter are defined. However, SD tendenci 
are somewhat more strongly negatively r 
lated to the tendency to endorse rare item 
and positively to the tendency to етріс 
“indifferent” responses. It might also be note 
that the significant negative correlation b 
tween I responses and the V (rare respons 
scale is a spurious function of the lack of 
items on the V scale. That is, if a pers 
endorses many I items, he will be less at 
to choose items which contribute to the 
scale. 

Turning to the interrelationships of t 
two ISD scales, it can be seen that the Е 
wards-style scale of most- and least-desiral 
items is significantly related to the Stroi 
style scale, but the correlation is low enov 
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CORRELATIONS OF SEVERAL MEASURES or RESPONSE TENDENCY WITH 49 SVIB-M SCALES - 
Scale PSD |ISDNo.1/ISDNo.2] v | L I | 
Group I | 
Artist -2* 28** =й 
Psychologist | 23 
Architect =25°* —20* 
Рһузїсїап —20* —24* А 
Osteopath | | 33 
Dentist —21* 
Veterinarian —34** —23* —39** 33"* 
Group П 
Mathematician —24* —24* 
poe —26** —36** 
Engineer —42** 
Chemist —35** a 
Group III i 
Production Manager —25** | 
Group IV 
Farmer —55** —52** —26** 
Aviator —38** —49** —2g** 
—43** — {gre —27** 5 
Math-Science Teacher 20* a We e [lam 32'* 
Industrial Arts Teacher —45** —57** —3g** 25** 24* 
Vocational Agricultural Teacher —53** = 55 er = Jo% 28" 
Foliceman 20* —21* 30+ n 30** 3a 
Forest = Е ж 5" 
Group V 20* =” cbe —46** 23 a 
YMCA Physical Director - " ^ 42** 
Personnel Director м 20* == 32 45** | 
Public Administrator 25** Lu 49" 
YMCA Secretary 26"* —26 ‚+ 47** 
Social Science HS Teacher E - ge 
City School Superintendent 32** =z 50** 
Social Worker 21* 41** 
Minister 20* 35** 
Group VI ` 
Мизїсїап * 
Group VII -H 
CPA * * 
Group УШ =25 | ше] шь =e | oc 
Senior CPA 
Accountant r =29** = 
Office Man E 1 20* 
Purchasing Agent =a" 31 
Banker 25% \ 
Mortician 
Pharmacist jn 24* " 
Group IX 25e 22 
Sales Manager 
Real Estate Salesma; su 29** 
man 
Life Insurance Salesman 34* 38** 
Group X * 47** 
Advertiser 
Lawyer dos —34** -22* 
Author-Journalist 45** 28** -27* 
Group XI ges 40** —23* 
President Manufacturing Concern 315 —28* 
21* 32** 
Specialization Level 325 36** 
Interest Maturity 50% " 45" à 
Occupational Level 26** 24* 37 
Masculinity-Femininity 25s 1 28** 33** 
—28** | —49% | —20* 
*p < .05. 


** p < 101. 
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to preclude the assumption that they are 
measuring the same variable. 

Table 3 shows the correlations between 
the six response tendencies and all scales 
of the SVIB-M. In interpreting this table, it 
should be remembered that occupations within 
groups are more highly related to each other 
than to occupations outside a given group. 
Thus, if a response tendency correlates to an 
extent with one scale in a group, it is likely 
to correlate similarly with all in a group. Cor- 
relations with a р > .05 have been omitted. 

First glance at Table 3 should suggest 
that the Group IV scales of technical occupa- 
tions seem to be exceptionally vulnerable to 
response sets, especially to endorsement of 
interest-measure defined socially undesirable 
and rare responses. The several Teacher scales 
ìn this group and Policeman and Forester 
scores are also noticeably affected by the 
tendencies to endorse L and I responses. Since 
these correlations appear on two of the three 
response alternatives, one may say that scores 
On these scales covary with the tendency to 
avoid responding in terms of dislikes. None of 
the other SVIB groups appears to be so 

ighly correlated with so many kinds of re- 
sponse tendencies. This finding is in accord 
With those of Walsh and Keasey (1966). 

Taking each scale of response bias in order, 
Some observations are appropriate as to its 
Main area of influence. As already noted, 
the tendency to describe one’s personality 
SD terms has a moderate relationship with 
Social service similarities. But also notable 
is this scale’s relationship (P < :01) with all 
9f the nonoccupational scales. Increasing 1n- 
terest maturity, particularly, is associated 
With socially desirable self-description (PSD) 

Ut not with endorsement of SD interests. 

he same is true of the Occupational Level 
and Masculinity-Femininity scales. : 

. The tendency to endorse socially desirable 
Interests, especially those more desirable than 
Dopular, tends to make one look like persons 
їп persuasive and verbal occupations and un- 
tke science and technology occupations. This 
antithetical relationship between these groups 
ОЁ interest similarity is visible in other re- 
Ports, for instance, Darley and Hagenah’s 
(1955) frequency tables of profile pattern- 
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ing. The Edwards-type ISD scale has cor- 
relations with the occupational scales similar 
{о the Strong-type ISD measure, except in 
Group X. There, the positive correlations on 
the V scale tend to repeat the stronger cor- 
relations of the desirable-but-rare scale. 

Here it might be asked if the component of 
SD interests in any occupation is related to 
the degree of prestige which is accorded the 
occupation itself. The correlation between the 
North-Hatt (1953) index of occupational 
prestige and the correlations of ISD No. 1 with 
the SVIB occupations is .13—not significant 
for an z of 34 occupations common to both 
scales. This suggests that the prestige of an 
occupation is not dependent upon the prestige 
of the interests associated with it, or that 
socially desirable interests are not sufficient 
if endorsed to produce similarity with prestige 
occupations. 

The tendency to select rare responses shows 
up as influencing scores in verbal occupa- 
tions, as noted above, and also in the artist 
and president of a manufacturing concern 
scales. The converse applies to Group IV and 
some social service scales: high scores on the 
rare set scale tend to be associated with low 
scores in these occupational scales. 

While Berdie (1943) shows that answer 
sheets filled out with all L responses enhance 
social service (Group V) scores, the present 
data show that the technical occupations 
(Group IV) covary to a greater extent with 
actual use of L responses than does Group V. 
The latter group covaries quite directly with 
I responses, as do the Teacher scales within 
the technical group. In addition, the I tend- 
ency forms a small but significant portion 
of variance in the Specialization Level and 
Interest Maturity scales. The OL and MF 
scales also show correlations with all of the 
SD scales and the V scale, but MF is in- 
versely related to all sets but PSD. 

'The one occupational group which seems 
least affected by any response tendency stud- 
ied here is VIII, Business Detail. There is no 
interpretable pattern of correlations within 
this group, and the largest proportion of cor- 
relations are just over the .05 level of prob- 
ability. Those which do appear may be the 
consequence of random variation. 


496 


CONCLUSIONS AND IMPLICATIONS 


Several conclusions may be drawn from the 
findings of this study. For one, response 
tendencies unique to interest inventories (L, 
I, and D) can be identified and measured. 
Second, tendencies originally identified in 
other affective domains (socially desirable and 
rare or popular) can be constructed within 
the interest domain, and in the case of SD are 
not equivalent with the same tendency in 
the personality domain. Further, the cor- 
relation between item SD and probability of 
endorsement in order of descending magnitude 
is: personality, attitude, and interest. Still 
the correlation on the SVIB is considerably 
larger than could be expected to appear by 
chance. 

While Walsh and Keasey (1966) did not 
find any major associations of variance from 
Tesponse sets associated with personality and 
attitude scales with SVIB scales, the findings 
of the present study appear to support the 
conclusion that Tesponse sets formed within 
interest items do "get through? 
amounts to many of the occupati 
In many, the correlations are larger than 
chance, but minimal in terms of interpreta- 
Чоп, On the other hand, 20-25% of the 
variance in Group V scores can be accounted 
for in terms of the tendency to endorse the 
I response. Slightly less variance in the Group 
II and IV scales is captured by a negative 
relationship to the use of socially desirable 
responses, and in Group X a large portion 
of a Scale score may be the consequence of 
choosing socially desirable but rare interests 
while avoiding the liking response, 

An important Practical question is whether 
or not the tendency to Tespond in accordance 


in varying 
onal scales. 


F 
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with a consistent set or bias makes any dif- 
ference in the occupational scale scores. s 
all, the SVIB is an empirical set of sca E 
normed on a variety of occupations, and ce à 
tain tendencies to respond may be a na 
of the essence of the occupation capture E 
any scale. Granting this, but given a a 
who has, say, all of the interests approp ain 
to a Group IV occupation, but who = 
tends to endorse socially desirable d 
enough may be taken off his рр ИЕ 
score to reduce it to an equivocal level. е is 
light of this prospect, it is importan Pe: 
understand just how certain response 

contribute to scores on the Strong Blank. 
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DIFFERENCES IN 
PATTERNS AS A FUN 


OPINION-SURVEY RESPONSE 


CTION OF DIFFERENT 


METHODS OF SURVEY ADMINISTRATION 


JOHN R. HINRICHS + 


IBM Corporation 
White Plains, New York 


For a population of mal 
the method of responding to an 
level of responses given. However, 


administered did have an effect on response. 


on their job locations under the super 
was a tendency to respon 


opinion questions, particularly questions 


eral,” than when they were permitted 
underlying dynamics of this result 
that the method of questionnaire a 
source of distortion in employec-opinio: 


Today the employee opinion survey isa 
Widely “used tool available to managers of 
arge industrial organizations for evaluating 
vienificant aspects of their company's opera- 
es and to social scientists studying the 

€raction of individuals and organizations. 
ia use of opinion surveys in industry has 

Teased markedly in recent years, and in 
ау companies data from these types of 
ser find their way into a variety of 

Nagement decision-making considerations. 
Urveys are utilized to audit management 
Practices, to evaluate the state of employee 
каме, to understand the dynamics of work- 
с motivation, to evaluate training needs, 
3 Audit the effectiveness of differing super- 
d and leadership strategies, to clarify 

@nnels of communications, and so forth. 
"ia id many years of experience and con- 
sur €d refinement and polishing, the opinion 
wae, has been developed into a reliable and 
бй id technique for evaluating a spectrum of 

8anizational problems. 
tt Owever, in contrast to the great deal of 
" €ntion paid to refining and polishing the 

Sntent of opinion surveys (ie, the actual 
estions which are asked), there has been 
tige lively little attention to the considera- 
i NS surrounding the mechanical administra- 
Tn of Surveys. A few studies have evaluated 
Шегепсев in attitude-survey responses col- 


1 
Now at Cornell University, Ithaca, New York. 


AND 


ROBERT D. GATEWOOD 


Purdue University 


e technical employees in a large national organization 
opinion survey made no difference in the 
the conditions under which the survey was 


When employees were surveyed 


vision of a company representative there 


d more favorably to a significant number of general- 


dealing with the "company in gen- 
to respond in a nonoffice location. The 


are not clear, but the significant point is 


dministration can serve as a potential 
n-survey data. 


lected under conditions of complete re- 
spondent anonymity versus conditions in 
which respondents were identified on their 
questionnaires. In reviewing this literature, 
Rosen (1960) concludes that, while statis- 
tically significant differences have been found 
in a number of these studies, “most of the 
researchers state that the differences be- 
tween anonymous and identified subjects 
were of little practical importance [p. 676]." 
The 10 studies which he cites cover groups in 
academic, military, or community settings. 
Rosen concludes that there is not apt to be 
serious distortion as a result of respondent 
identification in situations where the survey 
is conducted under less than highly threaten- 
ing circumstances. 

Pelz (1959) arrives at а similar conclusion 
following his study in a government agency. 
He found practically no differences in survey 
data collected under conditions of full ano- 
nymity versus identification with assurances 
that replies would be confidential among the 
researchers who came from an outside survey 
organization. Pelz termed both of these con- 
ditions as relatively unthreatening. 

Somewhat in contrast to the rather mild 
effects noted in these nonindustrial studies, 
however, two studies in industrial settings 
suggest that significant distortion can occur 
under different survey-administration condi- 
tions, and that this distortion increases with 
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the degree of perceived threat to the in- 
dividual. Klein, Maher, and Dunnington 
(1967) found that identified survey respond- 
ents in a manufacturing environment registered 
more favorable attitudes than anonymous re- 
spondents, particularly on items dealing with 
salary and with top management. These differ- 
ences were more marked under conditions of 
high threat (S's immediate manager desig- 
nated whether he would be in the identified 
or anonymous subsample) than was the case 
under conditions of low threat (Ss assigned 
randomly to the two conditions). Dunnette 
and Heneman (1956) present data showing 
more favorable attitude-scale responses under 
high-threat conditions (the personnel manager 
of the respondents! company administered the 
questionnaire) than under low-threat condi- 
tions (a research team from a university 
Served as survey administrator). Neither of 
the groups in the Dunnette and Heneman 
study were identifed and participants were 
explicitly asked not to sign their names to 
their questionnaires. 

These two studies suggest that more than 
just the issues of identification versus ano- 
nymity are important potential sources of 
distortion in industrial opinion-survey re- 
search. It would appear that implicit threat 
resulting from the environment in Which sur- 
vey forms are filled out tends to influence the 
degree of response favorability within in- 
dustrial settings. One important variable in 
the administration of opinion surveys not 
covered in these studies is the question of 
possible differences in the data resulting 
from mailed versus group-administered opin- 
lon questionnaires, 

Only two studies 
industrial setting, 
With this aspect o 
Barnett (1965) rep 
202 college student 
of interfaith marri 


Were found, neither in an 
Which dealt Specifically 
f survey administration, 
orts data on attitudes of 
S toward different facets 


E age which Suggests more 
favorable opinions when the data were col- 


lected within the classroom than when the 
questionnaire was completed outside of the 
classroom. However, the results are some- 
what ambiguous, and no statistica] analysis 
is presented. Bell, Hartup, and Crowell 
(1962) found that mothers who completed a 
Parental Attitude projective questionnaire at 
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home had significantly lower total gon 
based on 20 scales than did шш 
participated in a supervised group end 
tion. They hypothesized that mail perpen 
tion resulted in more deliberation and ca 
lectualization and therefore fewer a? i 
endorsements than is the case in ШОНА я» 
ministration. Neither of these pop M po- 
ever, provides any real insight into inion 
tential data distortions of industrial Wail 
surveys which may be attributed da ad- 
versus group-techniques of questionna 
ministration. "T" im- 
This paper deals with two basic pen 
portant in the administration o beer 
questionnaires in industry: (а) i praes 
opinion data collected through mai ollected 
tration of questionnaires with pecie con- 
through group administration un a data 
trolled situations; and (5) it pe ra 
collected by having the respondent booklet 
his answers on the questionnaire of a 
itself with data collected by means 2 
separate answer sheet. The purp еі ad- 
study was to see whether these diffe arable 
ministration conditions yielded con dence 
results or whether there are any osi in 
of bias as a result of these manipula san any 
the method of administration, apart o denti 
explicit consideration of respondent 
fication or anon mity. + nificance 
These Siete AA practical signif “itoa 
because for each of the two comp im rations 
tions there are rather powerful consi «s ve 
arguing in favor of one approach industria! 
other. Group administration of ai appeat® 
questionnaire at the place of wor 5 
more desirable than mailing it to e inifor 
homes because: (а) it provides for ollecte? 
conditions under which the data A survey 
(5) it provides an opportunity for clarify 
administrator to answer questions F4 to yie А 
any ambiguous points; (с) it ten i] survey? 
a higher rate of response than à a ead in ê 
(d) it permits the data to be ma e) there 
relatively short period of time; an ostage- Оп 
is some saving on ће expense of Mon ie 
the other hand, group administrat! sd 
the potential danger of c е p А 
through some unknown amount 0 mity y 
sion about possible lack of anony lected ° 
having the forms completed and СО 
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OprINION-SURVEY RESPONSE PATTERNS 


the company premises; there is a possibility 
of group norms operating in some inexplicable 
way to influence responses; there is a pos- 
sibility that employees will feel they were 
forced into participating against their will. 

With regard to the second issue addressed 
in this study, there are several potential ad- 
vantages to using an answer sheet to record 
survey data rather than having respondents 
answer directly in a questionnaire booklet. 
Most importantly, answer sheets can be 
machine scored and converted into punched 
cards eliminating the time consuming and 
expensive process of key-punching. Answer 
sheets are also easy to handle and maintain. 
In addition, the questionnaire booklets may 
be utilized more than once. On the other 
hand, there is probably more potential for 
respondent error in recording responses on an 
answer sheet than exists when the actual 
response alternative is circled in a question- 
naire booklet. 

For this study, two hypotheses were formu- 
lated with regard to these issues: 

Hypothesis 1: Employees who complete an 
opinion survey under group-administration 
conditions will register more favorable atti- 
tudes in certain specific attitude areas than 
will a comparable group of employees par- 
ticipating in the survey through mail-admin- 
istration conditions. Specifically, it was hy- 
pothesized that ratings of immediate manage- 
ment, of work associates, and of salary would 
be higher under the office-administration con- 
dition than in a mail survey; it was presumed 
that group norms would tend to yield rela- 
tively high ratings of work associates, and a 
reluctance to criticize local management— 
either directly or in terms of the manager’s 
Salary-administration activities—would іп- 
fluence opinions in these attitude areas. 

Hypothesis 2: There will be more error 
in the data collected through use of an answer 
sheet to record survey responses than will be 
true in data collected by circling responses 
Within the questionnaire booklet. Operation- 
ally, it was hypothesized that the variance 
9f the distributions of responses collected by 
answer sheets would be inflated by a larger 
Component of error variance than would the 
distributions for data collected under the 
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booklet conditions, and thus the answer sheet 
condition would exhibit larger total variance. 


METHOD 


Data for ihe study were gathered írom responses 
to a 150-item opinion questionnaire administered 
to a population of 13,000 technicians in a large 
national organization. The population of technicians 
was physically located at roughly 200 different 
locations. A representative sample of 16 of these 
locations was selected to be administered the ques- 
tionnaire in small groups within the office. In the 
group sessions it was explained that the results 
were completely anonymous and participation was 
voluntary (several individuals in fact elected not to 
complete the survey). In the group session, each 
individual was given a separate envelope into which 
he could place his completed questionnaire before 
they were collected and mailed to the survey re- 
search representative. 

There were 843 employees in these 16 specially 
sampled offices. Approximately half of them were 
instructed to circle their responses to the questions 
directly within the questionnaire booklet and return 
the entire booklet; the other half blackened the 
space on a standard test-scoring answer sheet which 
corresponded to their response to the particular 
questionnaire item. The answer sheets contained 
spaces for all 150 items on one side of an 815 X 11- 
in. sheet of paper and were designed so that they 
could be read directly into an IBM 1232 optical 
mark scoring reader producing punched-card output. 

The remainder of the population of technicians 
received the questionnaire in the mail at their homes 
along with a stamped return envelope addressed 
directly to the survey researcher. All of these in- 
dividuals utilized the optical mark scoring answer 
sheet. The mail survey resulted in a 75% response. 

A second sample of 16 offices was selected from the 
mail-administered portion of the survey to match 
the “in-office” group of 16 offices as closely as pos- 
sible in terms of size (number of employees assigned 
to the office) and in terms of geographic area. Data 
from this matched sample of 16 offices form the 
mail-administered condition discussed in this study; 
there were 979 technicians included in this sample. 

To summarize, there were three conditions of 
survey administration which are contrasted in this 
paper: 

(a) a group of 357 technicians who circled their 
responses to the questions within the questionnaire 
booklet and who completed the questionnaire in 
the office under group conditions (Office, Booklet 
Condition) ; 

(b) a group of 486 technicians who utilized the 
answer sheet, completing the questionnaire in the 
office (Office, Answer Sheet Condition) ; and 

(c) a group of 979 technicians, utilizing the answer 
sheet, who responded to the survey at home follow- 
ing mail administration (Home, Answer Sheet 
Condition). 
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RESULTS 


Responses to 41 key questionnaire items 
which asked the respondent to rate his degree 
of satisfaction or dissatisfaction with various 
aspects of his work role were factor analyzed. 
Eight distinct components being measured 
by the survey were identified following an 
oblique rotation of the data. These factors 
were: 


‚ Relationship with immediate manager. 
Attitude toward the company in general. 
Perceived demands of the job. 
Rating of the work itself, 
. Attitudes regarding future opportunities. 
. Extent of harmony and cooperation in 
the work environment. 

7. Feelings of job security. 

8. Evaluation of salary, 
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The highest loading items within each of 
these eight factor areas were chosen for anal- 
ysis in testing the two hypotheses. Altogether, 
32 items were chosen with factor loadings 
ranging from .36 to 78. 

To investigate the effects of type of ad- 
ministration on response—the first hypoth- 
esis—é tests of the difference between the 
mean scores of the selected 32 items were 
computed for each of the three questionnaire- 
administration conditions. As Table 1 in- 


TABLE 1 


NUMBER or QUESTIONNAIRE Item COMPARISONS Ex- 
CEEDING THE INDICATED LEVEL or SIGNIFICANCE 
FOR ¢ TESTS AND Р Tests COMPARI 


Administration conditions compared 


Office, Booklet Office, Booklet | Office, Answer 


versus versus Sheet 
Office, Home, versus 
Answer Sheet Answer Sheet Home, 


Answer Sheet 
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dicates, comparison of the scores boa in 
two groups that responded in the office > e 
that only 2 of the 32 items pere үз 
significantly different at the .05 leve ad ji 
nificance (two-tailed tests). This re MR 
what one would expect by pure chance that 
However, when the data for the T ctn 
participated in the mail survey ppm 
trasted with those of either of me Seed 
groups (both Booklet and ae к 
groups) a larger than expected Me nificant 
significant £s result. There are six cc = 
Us at the .05 level (one-tailed ek an 
Office, Booklet versus Home, v for the 
group (x? = 8.53, р < .005), and Answer 
Office, Answer Sheet versus y As hy- 
Sheet group (xy? = 43.20, р < .00 n items, 
pothesized, for a significant number уйл 
the Office group responded more ted in Ше 
than did the group which Lee p ж ten 
mail survey. The data suggest that AS means 
frequency of significantly differe aerei 
occurs in the attitude component ipae MOT 
"the company in general.” The maj 
reflecting these differences were: „айй 
аѕ 2 


How would you rate the XYZ company companies 


pany to work for compared with other jat 
y А y W! 
if Jes tur die you joined the og nA 
you know now, would you come to Fi com- 
Do you feel that the top managers 0 welfare 9? 
pany have a genuine interest in the 

happiness of company employees? 


to be 
The remaining significant /'s vn сот“ 
Scattered through the other а first hY* 
ponents. Thus, the basic part of t ubhypot* 
pothesis was confirmed, but Ше de areas 
esis regarding the specific atti arked Y 
Where differences would be most m В 
not confirmed. А at 15, 
To evaluate the second hypothesis; pum 
that error would be introduced by p tests 


eet. 
Ss respond on a separate answer h a " 
were conducted on the variance that foU? 


selected items. A pattern similar to tween : 
from the £ tests was evident. о ре 
two In-Office groups (Office, pets of Rer 
versus Office, Booklet) only one dal 5 leve: 
variances differed significantly at үи group? 
But, between each of the In-O ven 8187 y 
and the Mail group, there were pe In ? 
cant P ratios (y? = 13.33, p < 0 
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Cases, the variance of the item when answered 
by the Mail group was greater than the 
variance of the item when answered by the 
In-Office group. Again, a preponderance of 
the significant F ratios was found in the 
items clustered under the factor of Company 
in General and the remainder scattered among 
the other attitude components. Thus, the 
Second hypothesis dealing with differences in 
answer-sheet versus booklet response modes 
Was not confirmed by the data. 


DISCUSSION 


It would seem that a certain amount of 
distortion occurs when employees respond to 
an opinion survey in group sessions at their 
place of work as opposed to responding in 
some other setting. These results suggest 
that, with a greater than chance frequency, 
employees tend to give a more favorable re- 
Sponse to opinion questionnaires when sur- 
veyed at their office locations than when sur- 
veyed by mail at home. The tendency is par- 
ticularly true with regard to global evalua- 
tions of the company as a place to work, 
which tends to parallel part of the findings of 
Klein et al. (1967) regarding attitude areas 
most susceptible to distortion under threat. 

These differences have practical significance 
for the interpretation of opinion-survey re- 
sults as well as statistical significance. De- 
Spite the large sample sizes utilized in this 
study, from 5 to 8% fewer individuals re- 
Sponded to the favorable response alterna- 
tives under the mail conditions than under 
the in-office condition for those items yielding 
Significant ż tests. Distortions of this magni- 
tude are clearly important in the interpreta- 
tion of opinion-survey data. 

No definite evidence can be offered from 
the data at hand as to which is the “true” 
response, nor is it at all clear why this tend- 
ency is particularly evident with items deal- 
ìng with the company in general. Perhaps the 
Act of assembling groups of employees and 
taking time away from the workplace to ob- 
ain their opinions about a number of im- 
Portant areas serves as a tangible symbol of 
Company concern for the individual and tends 
0 influence ratings of the company in a 
Avorable direction—a situation analogous to 
а "Hawthorne effect” spilling onto the com- 
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pany in general. Conversely, it may be that 
a survey received in the mail is not ac- 
companied by this same type of tangible 
evidence of concern. 

An alternate explanation might assume that 
there is a higher probability of inhibitions 
to honest and frank response in the within- 
office condition than under the mail condi- 
tion; presumably, this type of inhibition, 
whether conscious or unconscious, would tend 
to inflate the level of favorability of survey 
data collected in group sessions but not to 
operate in the more demonstrably anonymous 
mail survey. 

A question dealing with the respondent's 
preferred method of survey participation was 
included among the 150 general-opinion ques- 
tions in the questionnaire. Responses to this 
question show that a majority (62%) of these 
technicians preferred to fill out the question- 
naire at their convenience and mail it back. 
Those who received the questionnaire in the 


mail overwhelmingly preferred the тай 
method (86% preferred it); a significant 


number of those who filled it out in a group 
meeting preferred the group method (4496), 
but a significant number of the group par- 
ticipants (33%) would have preferred in- 
stead to have received it in the mail at home; 
the remaining group participants (2396) 
stated they would have preferred to have the 
questionnaires handed out at work to be 
completed at their convenience and mailed 
in directly. This majority preference for non- 
group-survey administration tends to suggest 
that inhibitions operating in the group situa- 
tion may be at least partially responsible for 
the differences observed in this study. How- 
ever, at the present time the exact reasons 
for the observed differences must remain a 
matter of conjecture; the significant points 
are: (a) that the two administration con- 
ditions do not yield completely comparable 
results, and (5) that the in-office administra- 
tion conditions tend to yield more favorable 
ratings than mail administration. 

The second hypothesis dealing with errors 
introduced through use of the answer sheet 
was not supported. The lack of differences be- 
tween the two groups which answered the 
questionnaire in the office tends to indicate 
that, as such, the separate answer sheet had no 
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effect оп the respondents. If, as was hy- 
pothesized, the separate answer sheet had 
served to increase the number of errors in the 
mechanics of answering, one would expect the 
item variances for that group to be larger 
than the item variances for the group not 
using the answer sheet. 

However, the results do lend support to the 
idea of distortion caused by the method of 
administration. For a significantly greater 
than expected number of comparisons, the 
item variances of the mail-administration 
group exceeded those of the office-adminis- 
tration conditions. Perhaps this increased 
variance results from a reduction in pressure 
(either conscious or unconscious) to respond 
in a socially acceptable fashion, or perhaps 
respondents feel less constraint against using 
the full scale of the response alternatives 
when answering within the relatively neutral 
atmosphere associated with the mail survey. 
We are unable to say what the reasons are 
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from these results. But the data do clearly 
suggest significant differences between mail- 
and group-survey administration conditions. 
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AN ENQUIRY INTO THE EFFECT OF EXPOSURE 


TO ADVERTISEMENTS ON SUBSEQUENT 
PERCEPTION OF SIMILAR 
ADVERTISEMENTS 


DALE H. BERG 
University of Alberta 
This study tests the hypothesis that forced exposure to advertising lowers the 


threshold for perceiving the advertisements. The enquiry gains its import in its 
relevance to the basic question: what is the effect of continued exposure? Using 


2 groups, 


Control and Experimental, of late-teenage girls, a straightforward 


“before-after” experiment was designed wherein the experimental group was 
exposed to a certain form of advertising. The study consisted of 3 phases. The 
1st phase involved the determination of a “perceptual sensitivity” base score. 
The 2nd phase involved exposing the Experimental group to the form of ad- 
vertising under study. The 3rd phase consisted of remeasuring the perceptual 
sensitivity of both groups. The study demonstrated that forced exposure does 
increase perceptivity. The Experimental group showed significant differences in 
perceptual level from the Control group when remeasured in the 3rd phase. 


The present century has witnessed tre- 
mendous changes in the use of mass media 
to sell commodities and to control people. The 
utilization of mass communication has ex- 
panded at almost geometric progression. 
Placed in the right magazines or newspapers, 
televised at the right time, or broadcast via 
radio, the desired message can reach the 
eyes or ears of a small nation of people. 

In spite of the fantastic possibilities of 
exposing populations to propaganda, ques- 
tions persist regarding the effects of exposure. 
It is, for example, one matter to say that 
800,000 readers have seen a particular issue 
of a magazine, and an entirely different matter 
to contend that through their exposure they 
have absorbed the desired message. 

The faith placed in the effectiveness of the 
mass media is evidenced by the amount ex- 
bended each year on advertising and advertis- 
ing research. In spite of the fact that a few 
isolated cases exist in which a company has 
Dot advertised and has been successful (е.5., 
The Hershey Company); the mass media are 
regarded as a highly effective means of chang- 
ing attitudes and consumer habits. 

Some investigators in the field have sug- 
gested that the impact of advertising is gained 
through repetition. The idea is that percep- 
tion of advertisements is generally at such a 
Ow level of interest that it takes a con- 


siderable amount of exposure to produce even 
a negligible effect. It has been suggested that 
much advertising material is learning accord- 
ing to principles that hold for the memoriza- 
tion of meaningless nonsense material (Krug- 
man, 1965). 

Lucas reports that when readers of maga- 
zines were shown current issues and asked to 
report on advertisements that were familiar 
to them, many reported familiarity with ads 
which had not yet been published (Lucas, 
1940). This finding would indicate that 
familiarity is at best superficial. 

In spite of the suggested low level of aware- 
ness of magazine advertisements, reader re- 
sponse indicates that at least some people are 
concerned about the content of advertise- 
ments. Recently, there has been a considerable 
expression of concern regarding advertise- 
ments of brassieres and girdles that picture 
models in these garments. Frequently, dis- 
traught readers of the various publications 
that carry these advertisements write letters 
to the editor expressing fears that these photo- 
graphs are having adverse effects on those 
who see them, especially males and children.* 

In spite of Krugman's (1965) contention 
that much of advertising material is learned 


1 Letters to syndicated “lovelorn” columnists, and 
“call-in” radio programs, women’s magazines, news- 
papers. 
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TABLE 1 
AGE DISTRIBUTION OF SUBJECTS 


Experimental 
Age Control group group 
16 1 F 
17 ә 
18 18 e 
19 6 б 
20 = } 


on a very low level of interest, the amount of 
resistance stimulated by using photographs in 
brassiere and girdle advertising suggests that 
such advertisements are being noticed on more 
than a superficial level by at least some 
viewers. Krugman's conclusions might still 
be applied to the copy of these advertise- 
ments less often noticed. 

A key issue remains the question of the 
effects of continued exposure. Shall it be 
assumed, for instance, that continued ex- 
posure results in increased awareness? It 
would then seem that by the continued use of 
such advertising it may be possible to reduce 
and perhaps even eliminate public aversion. 
It might be postulated that increased per- 
ceptivity reduces aversion to such forms of 
advertising, if for no other reason than that of 
familiarity. 

At least two questions are raised: (a) 
Does exposure to advertising lower the thres- 
hold for perceiving the ads? and (b) If so, 
is increased sensitivity associated with an 
altered meaning assigned to the stimuli (e.g., 
reduced aversion) ? 


This investigation is concerned with the 
first of these questions. 


This study tests the hypothesis that forced 
increased perceptivity. 
S as Ss, an attempt was 
т awareness of brassiere 


ments by experimentally 
considerable amount of 


and girdle advertise 
exposing them to a 
such advertising. 


PROCEDURE 
Subjects 


Sixty young women residents 
class of a nursing school served as Ss, These 60 
were drawn from a class of 117 girls. These women 
ranged in age from 16 to 20, with the mean age 


in the first-year 
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at 18. The modal age (34 Ss) was also 18. Te 
60 women were divided into an кон ae 
a Control group with age distributions as sho 

in Table 1. NN 

All participants in the study, even those m 
nated in the first phase, were purposely misle teste 
garding the goals of the study. Prior to ee E 
ing, the students were told that the stu Y = 
concerned with their reactions to all feme is 
magazine advertising. The researchers were p an 
be interested in their reactions to various lay = 
designs, colors, copy, and brand-name d 
In other words, what was supposedly being соя 
was their personal reaction to numerous magaz: 
advertisements. 

Prior to the second phase, Ss were шины ke 
rive the advertisements under study their u nal 
attention and to respond in terms of their pne 
reaction. They were impressed with the idea iu 
what was desired was their honest reaction Sr a 
advertising effectiveness could be reliably studie S 

Follow-up questioning, to be described age ied 
dicated that the deception worked without ex s 
tion. The Ss seemed unaware of the actual purP 
of the study, 


Technique 


s; j 
A stereoscope is uscd to present an S with Sh 
different pictures, one to each eye, simultaneous? 
for a “just-perceivable” interval. difica- 
The present investigation represents a modi jt 
tion of the usual technique, dual projectors s 
coupled shutters, in that we have used з hus 
box with divided perceptual fields. Contrasting Р! a 
tures were thrown against a translucent screen kis 
that a different image was presented to each кш 
Using a single 35-mm. transparency with two Pie 
tures on it, positioned to project exactly on nly 
two perceptual fields, it was possible to use AN 
one projector mounted with a shutter. In о a 

the problem of synchronizing two shutters W! 
mechanical coupling device was eliminated. 
use of one shutter assured that the presentati 
were simultaneous, 

The one problem which was encounter 
not a mechanical one. It became obvious 5 
Very beginning that the material which ‘was com- 
projected, magazine advertisements, was quite use 
plicated compared to the material previously - 
by researchers using this stereoscopic technique’ ging 
vertisements contain not only pictures, hut r* a 
of various sizes. Color combinations NIS N 
also added to the complexity of the stimuli. А 
became necessary to adjust the usual Jen ile 
exposure in such a manner as to make it Р! yet 
to perceive the pictures being presented - 
retain the “just-perceptible” effect upon W ve onl) 
technique depends. It is essential that 5 pat etually 
enough time to perceive the pictures, withou d was 2 
being cognizant of them. What was neede ow 9^ 
Shutter speed which was slow enough to sugli te 
image to be formed on the retina and fast “ar from 
Prevent 5 from reporting both pictures 


jons 


d was 
ү the 
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EFFECTS OF EXPOSURE TO ADVERTISEMENTS 


cognitively appreciating both pictures for such a 
Period of time as to allow her to choose consciously 
which picture she would report. Preliminary studies 
indicated that 155 of a second allowed “time for per- 
ception” without “time for recognition.” 

Color advertisements of all varieties were clipped 
from magazines of the large size (10 Х 13 in). 
These advertisements were paired using several cri- 
teria such as color similarity and similarity in terms 
of writing position and size of photographs. It was 
felt that color matching would reduce the effect of 
color dominance especially found in reds. About 50 
Pairs of advertisements were photographed, each 
pair being different. Of these, 20 pairs contained a 
brassiere and/or girdle advertisement using actual 
models. These ads were paired with non-brassiere- 
girdle advertisements. The brassiere-girdle advertise- 
ments, from here on referred to as the "critical 
Pictures,” were alternated from left to right posi- 
tions, 

Alternating the critical pictures assured that the 
effects of optic dominance would be eliminated. 
Eleven critical pictures appeared on the right side, 
the remaining nine on the left. 

АП of the slides were photographed against a 
dull black background so that in projection the only 
light appearing on the viewing screen would be 
that of the advertisement. The result was that ex- 
traneous light and other material were eliminated 
from the viewing field. A 300-w. projector was 
used because it produced a bright image without 
"burning it in" on the retina. 

Tt was decided as a result of the preliminary 
studies that a “warm-up” series of slides would be 
presented each S just prior to the "actual" run 
of the 50 slides. Preliminary studies indicated that 
not only did Ss need a warm-up period to accustom 
them to the device, but that some also required 
that their “blocks” to saying “brassiere” or “girdle” 
be broken down. Twenty slides were chosen for the 
Warm-up series, though in most cases the warm-up 
required no more than 12 slides. In the warm-up 
Series, the eighth and thirteenth slides were used 
to break down verbal inhibitions and were labeled 
“forcers.” 

This preliminary te 
Outside the population 


Experimental groups W 
tion of the Ss of report has been 


sting was conducted on Ss 
from which the Control and 
ere selected. Thus contamina- 
avoided. 


Method 
i in three phases. 
The study may be considered in tl 
hase One involves the determination of some 


bas i i erceptual change can be meas- 
Peck ctae Tie “educational” segment of the 
Study, Over a period of 5 wk, in biweekly ЖЕ, 
Ss were asked to judge the quality of es ad- 
Vertisements clipped from magazines. This phase : 
Critica] in that the Experimental group Was E 
Posed to brassiere-girdle advertisements, ЭШЕ е 

Ontrol group rated “innocuous” ads. Phase Three 


Measures change in perceptual sensitivity. 
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Phase One. The first phase, like the third phase, 
consisted of 50 paired projections oí advertisements 
shown at 155 of a second. Of the 50 paired projec- 
tions, 20 were critical slides (defined earlier). Thus 
the number of critical slides perceived out of the 
20 constitutes the base score in Phase One and the 
comparison score in Phase Three. Both Experimental 
and Control groups were run through this series. 

Fifty paired projections were used in an effort 
to conceal the critical slides so that Ss would not 
become aware of the nature of the enquiry. As 
noted beíore, concerted ейїогї was made to in- 
fluence the Ss to think that the study was con- 
cerned with all forms of advertising. Investigation 
by random interviews with the Ss at the conclusion 
of the study revealed that the 30 noncritical slides 
accomplished this desired end. 

The Ss were scheduled in 15-min. intervals for 
Phase One, allowing ample time for the warm-up 
series and the actual test series. At the beginning 
of Phase One, each S was given a series of warm-up 
slides. This allowed adjustment to the dark and to 
the procedure. 

The Ss were told to report all that they saw 
with both eves or only one eye if they only saw 
one picture. They reported to a female stenographer 
sitting next to them. This insured that Ss would not 
be inhibited by having to report seeing a brassiere 
or girdle to a male recorder. 

Slides Number 8 and 13 were the "forcer slides” 
in the warm-up series; that is, the “forcer slides” 
contained pictures of brassieres and girdles. Slide 8 
contained only one picture. The left side of the 
slide was opaque. The right side of the slide con- 
tained a picture of a girl in a brassiere. In this 
manner $ was forced to see a brassiere and thus 
forced into the situation of having to report the 
same. Slide 13 contained pictures of brassieres and 
girdles in both pictures. This too forced the S. 

If S reported “brassiere,” without hesitancy оп 
Slide 8, Slide 13 was omitted. Slide 13 was only 
used as a “forcer” in the event S blocked or 
hesitated unduly long on Slide 8. 

Those Ss who were too inhibited, that is, who 
blocked on both “forcers” even after several ex- 
posures to them, were omitted from the study. 
Those Ss who were not able to adjust to the Ys 
speed after extensive warm-up were also rejected. 
The number of Ss rejected for being too slow or for 
being overly inhibited was small, that is, 10 and 
з, respectively. | 

An Experimental and a Control group comprised 
of 30 Ss each were selected from Ss tested. The 
two groups were formed through a process of match- 
ing on Phase One scores and randomly distributing 
the paired Ss into either the control or experimental 
category. The number of critical slides perceived 
by each S is reported in Table 2. The total number 
of critical slides perceived in Phase One by the Con- 
trol group was 198 as compared to 199 in the 
Experimental group. The mean number of critical 


slides perceived is 6.6 for each group. 
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TABLE 2 
NUMBER or CRITICAL SLIDES PERCEIVED IN PHASES ONE AND THREE BY SUBJECT PAIRS 
IN THE EXPERIMENTAL AND CONTROL GROUPS 
Phase One/Three scores and amount of change 
Age 
Subject Control group subjects Experimental group subjects 
pair 
осы) Рһазе Change Phase Change 
€ E ecd 
I ш + - I IIT + 7 
1 18 19 3 8 5 3 13 10 
2 18 17 3 6 3 | 3 13 10 
3 18 19 4 7 3 | 4 12 8 
4 17 18 4 4 4 4 
5 19 18 4 133 | 9 h ow 6 
6 18 18 4 4 A i 9 5 
7 19 18 4 5 | 1 5 10 5 
8 17 18 5 2 3 5 
9 18 18 5 7 2 5 n H 
10 18 18 5 б | 1 | 5 7 2 
11 18 18 5 6 1 : 
12 19 17 5 à | i З w og 
13 18 17 5 s l 3 6 13 7 
14 18 19 6 4 2 | & 9 3 
15 18 19 6 9 3 6 {0 6 
16 18 17 6 9 3 
17 18 18 6 7 1 $ т 5 
18 18 19 7 6 1 i 2 5 
19 16 18 7 4 3 10 3 
20 19 18 7 9 2 И f А 
21 17 18 8 9 т | А 
22 18 18 8 8 | 8 12 4 = 
23 19 18 8 m 3 3 6 
24 17 17 8 5 8 E 13 5 
25 18 19 9 9 а ү 9 5 
26 18 20 10 1 2 
27 19 18 10 2 = 10 9 1 
10 10 4 
28 18 18 10 9 i 6 
29 17 17 12 10 10 13 3 
2 п 
30 18 17 15 11 12 1 
4 12 16 4 
"Total 199 222 43 20 igs 9 
311 m I? 
Means (N = 30) 6.6 74 14 3 
и a :67 6.6 10.36 4.0 : 


Phase Two. The second Phase of the study con- 
sisted of exposing the Experimental group to the 
critical advertisements while the Control group 
viewed noncritical advertisements, 

Actual advertisements, clipped from magazines, 
were given to the Experimental and Control groups 
separately for their judgment as to “quality” and 
“effectiveness,” 


These groups met twice a week for 5 wk = 
were exposed to 30 advertisements at each mee eni, 
Exposure was limited to 1 min. per advertise? g- 
which time included completion of the “ad jet! 
ment” form for each clipping. In total, them © 
S was exposed to 300 advertisements. 


N from 
€ Experimental group differed in exposure 12 


the Control group only in that it evaluate 


EFFECTS ОЕ EXPOSURE TO ADVERTISEMENTS 


critical ads, of the 30 each night. The noncritical ads 
Were identical for both groups. The Experimental 
E IBI then, received a 4096 "dose" of critical ad- 
ertisements as the “indoctrination” course. 

To control for the problem of postsession inter- 
communication between the Control and Ехрегі- 
mental groups, all Ss were reminded at each session 
Not to discuss the test with the other group or 
between themselves, as their individual judgments 
Were extremely important. The request was ap- 
Parently well followed as indicated by posttest 
questioning. 

In the event that talking might occur, it was 
decided to include five critical advertisements in 
the third session Control group packet. Thus if the 
Experimental group Ss would have remarked that 
they had been viewing an excessive number of ad- 
Vertisements for brassieres and girdles, they would 
encounter the reply that the other group also had 
this experience. 

The effectiveness of this deception rested on the 
assumption that the actual number of critical ad- 
vertisements given to the Experimental group would 
not have been counted and therefore the definition 
of what was excessive would be sufficiently devoid 
of meaning so as to remain unnoticed. 

Phase Three. After all the exposure sessions were 
completed and the few absences made up, Phase 
Three, the final phase, was conducted. This retest 
took place over three evenings. The Ss were 
scheduled every 10 min. for their projection sessions. 
Only one repeat of any slide was allowed and this 
was permitted to occur only aíter extensive quizzing 
for any possible image by the recorder. The quizzing 
made it obvious that there was little chance of 
having a repeated projection. Perception became 
much better after one encounter with the probing 
questions, "Didn't you see any image at all? 
Are you sure?” 

Since Ss were familiar with the stereoscopic tech- 
nique they warmed-up quickly and the 10-min. 
scheduling proved to be quite adequate. Three slides 
Were generally sufficient to adjust the eyes and the 
"forcer? (Slide 8) was given in fourth position. If 
S responded “Ьгаззїеге” to Number 8, she was given 
one more slide for deceptive purposes and the series 
of SO slides was begun, as in Phase One. The Ss 
Were always told when the actual series began = 
the warm-up period had ended. As in Phase One, 
all res ere recorded. р E 

A leans diagram of the study is included in 
Table 3. The diagram is divided into three wo 
and labeled as to the content in each phase: as 
Simplicity of design made the interpretation 0 e 


results quite straightforward. 


RESULTS 

mber of critical slides 
e and Three, are given 
the Control and Ex- 
The table also indicates 


perimental groups. 3 
н e numbers assigned 


amount of change. Th 
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TABLE 3 
SCHEMATIC DIAGRAM OF THE THREE PHASES 


Phase One Phase Two Phase Three 
Ascertainment of | Introduction of | Ascertainment of 
differential experimental change in 
thresholds for variables. differential 


thresholds for 
perception of 
sex-oriented 
stimuli. 


perception of 
sex-oriented 
stimuli. 


to Ss are matched as Ss were paired, thus S 1 
in the Experimental group has her counter- 
part S, Number 1, in the Control group. 

The mean number of critical slides per- 
ceived by both groups in Phase One was 
6.6. The mean number of critical slides per- 
ceived in Phase Three was 7.4 for the Control 
group as compared to 10.36 for the Experi- 
mental group. In terms of number of critical 
slides perceived, this means that the Experi- 
mental group perceived 113 more critical 
slides (net) in Phase Three as compared to 
the 23 more critical slides (net) by the Con- 
trol group. 

The null hypotheiss that the experimental 
variable, exposure, had no effect was assumed 
and tested at the .05 level of significance with 
a one-tailed test.” 

With 29 degrees of freedom, if £= 1.699, 
the null hypothesis would be rejected at this 
(.05) significance level. The SD was calcu- 
lated to be 3.45, and £ to be 4.62. The null 
hypothesis was rejected. 


DISCUSSION 


A classic definition of "attitude" holds this 
term to refer to “а tendency to respond to 
certain stimuli in a particular manner" 
(Trasler, 1962). The present study demon- 
strates that forced exposure to stimuli (famil- 
jarity) lowers the perceptual limen. This is 
one measure of attitude change, and it gains 
significance here because of our use of actual 
advertising materials, rather than less com- 
plex stimuli. 

As in all studies of attitude, the meaning 
of this particular form of attitudinal determi- 


2 A one-tailed test was used because direction of 
change had been predicted. 
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nation for other dimensions of behavior re- 
mains at issue. 

From this and similar investigations it may 
be assumed, for example, that the advertiser 
can increase “product awareness” through 
repetition. But the relationship between such 
increased perceptivity of the advertiser’s 
message and action upon it (buying) is a 
continuing question. 

Further, the findings intrude upon the 
censorship debate. It is clear that exposure 
to sometimes offensive materials increases 
the perception of them. What needs to be 
known is whether such familiarity reduces 
or increases the emotional valence of these 


stimuli. That is, does viewing items of second- 
ary sexual content reduce their impact, or 


does it stimulate other dimensions of attitude 
and behavior? 
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The problem under study was to examine the convergent and discriminant 
validity of interview and questionnaire measures of satisíaction and desire in 
5 different need categories. Using the Campbell-Fiske multitrait-multimethod 


framework, 
validity 


the results showed relatively high discriminant and convergent 
{ог the satisfaction scales, low convergent and moderate discriminant 


validity for the desire scales. The results suggest that the interview versus 
questionnaire controversy is not necessary; they also suggest that further work 


is needed in developing desire scales. 


Interviews and questionnaires are frequently 
Viewed as alternative sources of data for 
many problems in behavioral science research. 
If one method is used, very often the other is 
not. Interviews have been criticized because 
of their potential for having the interviewer 
draw from the respondent what he wants to 
hear (Dunnette, 1962, pp. 302-303; Hyman 
& Sheatsley, 1954, pp. 50-122). Question- 
naires, on the other hand, have been criticized 
because their impact on respondents often 
tends to be viewed as agonizing repetition of 
trivial questions in the misguided quest of 
science (Hechinger, 1966). The use of inter- 
views is based on the assumption that effec- 
tive tactics create an emotionally satisfying 
setting where the respondent is free to give 
his own views and where the investigator 
allows himself to be open to more information 
than is available in the usual fixed-response 
questionnaire. А questionnaire, however, is 
More amenable to precise quantification 
through scaling techniques. 

Until recently there has been little system- 
atic comparison of the two measurement tech- 
niques. Sears (1965), however, has shown 
that mothers’ attitudes toward permitting 
Sexual and aggressive behavior in their chil- 
wu 

l'The material in this paper is adapted from an 
Unpublished doctoral dissertation in the Depart- 
Ment of Industrial Administration at Yale Uni- 
Versity, 1966. The writer would like to express his 
appreciation to Charleen Alderfer and to Chris 

Tgyris, Edward Lawler, Vernon Buck, Thomas 
Lodahl, and Tim Hall for their help in the project. 


dren tend to be highly correlated when 
measured by interview and then by question- 
naire. The purpose of this paper is to present 
the results of a study designed to assess the 
validity of interview and questionnaire meas- 
ures of need satisfaction and desires by the 
multitrait-multimethod procedure (Campbell 
& Fiske, 1959). 


Theoretical Constructs 


The variables measured by interview and 
questionnaire were based on a conceptual 
scheme consisting of three need categories: 
existence, relatedness, and growth, For each 
need category, two attributes were measured. 
The first was desire. How important was a 
particular reward? How much did the re- 
spondent want it? The second was satisfac- 
tion. Satisfaction for each group of needs is 
defined in terms of a particular end state and 
a process for attaining that state. Existence 
needs have physical or material end points; 
they are reached by individuals getting 
absolutely or relatively enough. Pay and 
fringe benefits are the particular existence 
needs considered in this study. Relatedness 
end points refer to emotional states with re- 
gard to specific other people; the process 
for attaining them consists of two or more 
people sharing their thoughts and feelings. 
Respect by Superiors and Respect by Peers 
are the two relatedness needs of interest in 
this study. The end points of growth needs 
refer to the solutions of problems which lie 
within the actual or potential capacities of 
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TABLE 1 


SATISFACTION ITEMS Factor ANALYsIS 


Varimax factors 


Item Respect 
. | Fringe " .| Respect | Growth 
Pay Benefits by ume by Peers 
1. Considering the work required, the pay for this job is fair. | 
(Agree) ж | % | =o 02 04 
2. Compared to the rates for similar work here, my pay is good. 
(Agree) 2| 05 al 04 | 07 
3. My pay is adequate to provide for the basic things in life. 
(Agree) 37| 06 | —02 09 E 
4. In general I am satisfied with my pay. (Agree) 77 .16 17 04 15 
5. Compared to the rates for similar jobs in other places, my 
pay is poor. (Disagree) Б 76 A5 .09 99, —.04 
6. I find it hard to do some of the things T enjoy most on the 
pay I receive. (Disagree) 5 103 A3 
А 56 21 Бү: 0: 
7. Compared to the rates for less demanding jobs, the pay for 
my job is poor. (Disagree) 77 16 06 02 .05 
8. In general I am satisfied with the fringe benefits I receive. 
(Agree) : 49| se| o | | 02 
9. My job offers good fringe benefits, (Agree) 14 6 d4 07 06 
10, a to other places our fringe benefits are excellent, ` ` ў | 
gree 05 
Б 2 .06 : 
11. The fringe benefit Program does not give the security I want қ ui en i 
(Disagree) ` 22 70 03 08 
12. The ; ee benefit program here needs improvement, (Dis- І и a U 
agree) 7 04 
13. Our fringe benefits do not cover many of the areas they als 22 05 00 
should. (Disagree) 7 19 f 15 
14. It's easy to talk with my boss about my job. (Agree) 04 [^ дз J 03 
15. My boss takes account of my wishes and desires, (Agree) 10 10 p о 14 
16. My boss keeps me informed about what is happening in the i : 5% 9 ` 
company. (Agree) 06 10 07 
17. My boss often asks for my opinion about the job. (Agree) 04 ‘03 07 18 37 
18. My boss gives me credit when I do good work. (Agree) ‘Mt ‘05 20 ts 21 
19. Му Боѕѕ keeps a close check on his people. (Disagree) =T Е Г = n 
20. My boss will play one person against another, (Disagree) ‘00 05 E 06 06 
21. I feel that there are certain “right” things to tell my bos ә 7 s 
(Disagree) у зов. 0 т 04 
22. My boss does not let me know when I could improve m ini m = ке 
регїогтапсе. (Disagree) 25 25 0 .02 
23. My boss expects people to do things his way. (Disagree) ne a p 1 09 
24. My co-workers respect my opinions when I di pet е - id N | 
thers, (Agree) Isagree with j 19 
25. I can count Я i =A | =н 07 we | “ 
it. (Agree) on my co-workers to give me 4 hand when I need 08 
26. І can speak my mind to m :05 04 10 63 { 
У Co-workers, (Agr, ) 00] 
27. My co-work А Mec 07 04 | —04 d 
en €rs welcome opinions different from their own 15 
28. My co-workers are high] iti R ; :04 :04 .25 65 WE 
oodd Diasas У critical of each other When mistakes " 03 
29. My co-workers are uncooperati: it^ ; 05 02 03 ia : 
vantage. (Disagree) perative unless it's to their ad- 11 
30. My co-workers will not Stick out their necks for ae + 20 i | 
(Disagree) a m 18 
31. Т have few close friends among my co- i 03 19 21 А 101 
32. I have an opportunity to use many of e tud —.06 23 10 ge 
(Agree) work, 72 
К 16| 4 20 15 = 
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4 TABLE 1— (Continued) 
Varimax factors 
Ttem Respect 
Fringe Respect 
Pay by Supe- D ; 
* | Benefits Рае Ъу Реегѕ Growth 
P Careful planning is necessary in my job. (Agree) .09 | —.01 .06 .03 70 
- My job requires that a person use a wide range of abilities. 
35 (Agree) 04 | —.07 .00 .08 70 
5. Few things in my job give me a sense of accomplishment. 
Р (Disagree) —.07 16 .23 .02 42 
6. My major abilities are seldom needed at work. (Disagree) .06 14 .26 :05 50 
37. In my job I have the same things to do over and over. 
(Disagree) ла! ш 04 10 62 
38. This job has helped me to see some talents I never knew I 
had. (Agree) 01 44 .08 18 65 
39, My job is constantly changing. (Agree) —.02 .01 .00 .09 .68 
40. My job requires making one or more important decisions 
every day. (Agree) —.06 .00 .03 12 .65 
41. Тат rarely asked to try new ways of doing things at work. 
(Disagree) к А .08 .03 07 16 AS 
42. I seldom get the feeling of learning new things from my work. 
(Disagree) А .08 .10 22 —.09 68 
43. I do not have the opportunity to do challenging things at 
work. (Disagree) 0 45 15 42 68 


Note.—The highest loadings on each factor which are used to define the factor are italicized. 


the person, Integrating and/or differentiating 
one’s talents are the processes for satisfying 
growth needs. Using and learning skills and 
abilities are the growth needs of interest in 
this investigation. 


Validation Framework 


Campbell and Fiske (1959) have presented 
а systematic procedure for validation which 
is based upon convergent and discriminant 
Validation of more than one trait by more 
than one method. The convergent-validity 
Question asks whether different methods 
Purporting to measure the same trait correlate 
highly with each other. The discriminant- 
Validity question asks whether measures of 
traits Which are purportedly different from 
€ach other are uncorrelated. | 

When the Campbell-Fiske procedure is 
Used, validity information is contained in 
the “multitrait-multimethod matrix." Each 
entry in the matrix is defined by the coinci- 
€nce of one or two trait measurements by 
She or two methods. In the present study the 
Methods are interviews and questionnaires; 

€ traits are different need categories. (See 


able 4.) 


The diagonals of the matrix contain reli- 
ability and validity coefficients. Here reli- 
ability is defined as “the agreement between 
two efforts to measure the same trait through 
maximally similar methods.” Validity is de- 
fined as “the agreement between two efforts 
to measure the same trait through different 
methods” (Campbell & Fiske, 1959). 

In terms of the matrix, the question of 
convergent validity has a single criterion. Are 
the entries on the validity diagonal signifi- 
cantly different from zero and reasonably 
large? There are three questions to answer for 
discriminant validity. Is an entry in the 
validity diagonal higher than the values lying 
in its column and row where neither trait nor 
method are common? Is an entry in the 
validity diagonal higher than correlations be- 
tween that and other traits using the same 
method? Is the pattern of correlations among 
traits the same for each method and for the 
combination among methods? 


METHOD 
Subjects 


Approximately 300 persons served as Ss for the 
study. They were employees in the largest division 
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of a manufacturing organization and were randomly 
selected from a total group of about 1,700 people. 
The sample was stratified by departments and in- 
cluded job holders from the assembly line through 
four levels of management. From the total sample, 
about 130 People were randomly selected to be 


interviewed. All Ss were asked to complete question- 
naires, 


Procedure 


After an interview was completed a respondent 
Was given a questionnaire and asked to mail it back 
to the writer at Yale University. The remainder 
of the questionnaires were given out during group 
meetings where 10-15 people from different depart- 
ments were assembled, Depending on the time 
available the questionnaires were cither completed 
at the meeting or returned to the writer by mail. 
Approximately 90% of the people who participated 
in the study returned their questionnaires. 

While the interview 


tion had been completed the interviewer turned to 
the recorder and asked the respondent's permission 
to tape the interview. The person was again re- 
assured that no one in the company would ever be 
allowed to listen to the tapes. Of the people who 
came to interviews, 9576 gave their permission to 
record the material. 

All of the interviews were conducted by the writer, 
The tapes were then transcribed verbatim, These 


transcripts became the raw data for systematic 
content analysis. 
Almost without exception the questions were 


asked in the same order. They were open-ended, 
such as “What do you like to get out of a job?” 
or “Would you describe your boss for me?” There 
were 15 standard interview questions; the inter- 
views lasted from 20 min. to an hour and a half 
with a median time of about 35 min. The questions 
and the exact procedure Íor content analysis are 
given elsewhere (Alderfer, 1966). The writer and one 
other coder scored 75 interviews independently. 

Two different questionnaires were used in the 
study. Each questionnaire was designed to measure 
satisfaction with, and desire for, two needs in each 
of the existence, relatedness, and growth areas. 
They differed, in that one utilized the paired-com- 
parison method and the other a graphic rating scale 
to assess the desire measures, Satisfaction items were 
exactly the same on both instruments, 

Items for the Satisfaction scales appeared in a 
7-point Likert-scale format, They were counter- 
balanced so that in approximately half of the items 
a person had to agree to be scored for satisfaction 
and in the other half, disagree to be scored for 
need satisfaction. For the Paired-comparison desire 
measures, the items appeared two at a time; S 
was asked which was more important to him. The 
format departed slightly from the usu 


al paired- 
comparison procedure in that Ss had 


the option 
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an 
of saying that neither one was more important Ши 
the other. Each pair of items appeared plate 
desire score was obtained by counting аа aam d 
oí times an S selected a given item. The S two 
measure of desire had cach item followed “ating 
ratings, each on а 5-point scale. The und more 
was importance; the second was how muc 
the person wanted. 


RESULTS 
Satisfaction Scales 


The 43 items which were expected e ч 
stitute the six satisfaction scales were po 
correlated and factor analyzed by the Pith 
cipal components method. All factors vide 
roots greater than 1 were rotated by the were 
max procedure. The first five factors dir 
clearly interpretable. They can be verior, 
Pay, Fringe Benefits, Respect by БЕР tn 
Respect by Peers, and Growth Satisfac 
respectively, ing$ 

Table 1 gives the items and their oe 
on the satisfaction factors. Agree or wi 
after the item indicates the direction 0 the 
item scored for satisfaction. Because are 
items were expected to form factors, thes, i 
presented together to show which factors ap 
were intended to develop. They did not ae 
Pear this way in the questionnaires. In E в 
eral one can say that the factorial struct 
is quite close to the predictions. The eo 
major exception is that instead gf ug 
two growth factors, one for use up 
abilities and one for learn skills and — 
there is just one. Three minor exceptions jo 
also present, Keeping a close check on рер 
Item 19, was expected to be seen as lac op 
trust by the boss, but it loaded in the the 
Posite direction, although the loading mae ms 
smallest of the Respect by Superiors е 
Telling "right? things to the boss, a а 
to tap an aspect of perceived coniorm Ye 
essentially no loading on the factor. Per di 
this indicates that the item was not item 
sistently understood as intended because hings 
23, where the boss expects people to do t 8, 
his way, does load on the factor. pase Ti 
having to do with criticism by co-wor css 
loaded in the direction expected on the e 
spect by Peers factor, but it did not den 
a high loading. The item was intended pear 
flect punitive pressures against risk taking 
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VALIDATION OF SATISFACTION AND 


TABLE 2 


QUESTIONNAIRE SATISFACTION SCALES: NUMBER OF 
ITEMS AND MEDIAN ITEM CORRELATION 


DESIRE MEASURES 


TABLE 3 


INTERVIEW SATISFACTION SCALES: 
INTERCODER CORRELATIONS 


Factor No. items t Factor | т 
Рау | 7 .50 Pay .81 
Fringe Benefits | 6 | 40 Fringe Benefits | 71 
Respect by Superiors 8 EU Respect by Superiors | 84 
Respect by Peers 8 30 Respect by Peers | .70 
Growth ` | 12 AT Growth 76 


Note.—N = 302, 


but perhaps it was sometimes confused with 
simply pointing out mistakes. 

To estimate the reliability of the factor 
scores, the median correlation of items defin- 
ing the factor was used in the Spearman- 
Brown formula. The number of items is used 
for the number of replications? Table 2 
gives the median correlation and the number 
of items for each satisfaction scale? 

Table 3 gives the raw correlations between 
the independent interview codings for the 
five scales. When the coding was begun, 
the results of the factor analysis were not 
known. Consequently, separate scores were 
developed for satisfaction of use skills and 
abilities and for satisfaction of learn skills 
and abilities. After the factor-analysis results 
were available the two scales were added to 
form the interview growth satisfaction scale. 
The correlation between the two scales was 
.49, which is higher than the median item cor- 
relations from the questionnaire. 

Table 4 presents the multitrait-multimethod 
matrix for satisfaction scales. Each trait 1s 
abbreviated by the letters of its main words. 
The reliability estimates оп the questionnaire- 
questionnaire and on the interview-interview 
Matrices were calculated by applying the 
Spearman-Brown formula to the data in 


idity diagonal in the 
Tables 2 and 3. The dnd are doom {Не 
interview-questionnaire та A - 
ант aa between the interview and ques 
—1 mr 
m formula is "s = үг — 1); 
2 rman-Brown à { 

The Spes к of replications. In this study, 
ae mos n er of items which define the factor; 
m is the n correlation among items. 

r is the media were computed by the formulas 
, з Factor sor cipal components given by Kaiser 
or rotate! 
(1962). 


Note.—N = 75. 


tionnaire scale scores for the 111 interviewees 
who returned usable questionnaires. 

Viewing the reliability diagonals one can 
see that all the values are equal to or greater 
than .79. The median reliability is .87. The 
validity diagonal, located in the interview- 
questionnaire matrix, meets the criterion for 
convergent validity in four of five cases. All 
of the entries in the diagonal are significant 
beyond the .005 level. Only the coefficient for 
Satisfaction of Respect by Peers is relatively 
small, and that is larger than any off-diagonal 
value. All the entries meet the first criterion 
of discriminant validity: each is higher than 
any other value in the same row or column. 
All the entries also meet the second criterion 
of discriminant validity: each is higher than 
any correlation between two traits when a 
common method is used. The third criterion 
of discriminant validity is met if one is willing 
to assume that all off-diagonal entries ap- 
proach zero. Factor-analytic techniques “try” 
to find orthogonal factors, but the low cor- 
relations among interview variables exist with- 
out such mathematical gymnastics. Otherwise, 
there is no immediately discernible pattern 
among these entries.* 


Desire Scales 


As mentioned above, two different question- 
naire procedures were used to obtain desire 


The correlations in the questionnaire-question- 
naire off diagonals of Tables 4 and 8 capitalize on 
the specific and error components in the data to 
obtain such nearly perfect orthogonal factors. It 
would be a worthy task of future research to use the 
factor-score coefficients reported in this paper on 
another sample of people to cross-validate the 
findings reported here (Glass & Taylor, 1966). It 
is almost certain that the factors would not be as 
perfectly orthogonal as shown here. 
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measures. One was a graphic-rating-scale 
procedure, and the other utilized the method 
of paired comparisons. Approximately halí 
of the interviewed Ss Were asked to use each 
type of questionnaire. Data will be presented 
concerning the convergent and discriminant 
validity of each kind of questionnaire with 
the interview, 

The 28 rating-scale items which were ex- 
pected to constitute the desire scales were 
intercorrelated and factor analyzed by the 
principal components method. All factors with 
Toots greater than 1 were rotated by the 
Varimax procedure. Five of the first six factors 
were clearly interpretable, They are the same 
as the satisfaction factors: Pay, Fringe 


Benefits, Respect by Superiors, Respect by 
Peers, and Growth Desires. 


Table 5 presents the items 
ings on the desire factors. 
“more” after the item indic 
in which the variable appeare 
naire. Even though all items 


and their load- 
"Important" or 
ates the format 
d in the question- 
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an “important” and a “more” format, = 
factor loadings show a different pattern the 
these two kinds of variable depending ie 
need area. Existence and growth к d 
Fringe Benefits, and Growth—have Eo I 
ings from both types of items on кре 
spective factors. Relatedness пеейз— have 
by Superiors and Respect by Peers— nly. 
high loadings on their “more” items НОП 
Apparently there is not a linear corre ў" 
between saying one wants тоге wp 
trust and saying that it is important. m 
is a decidedly different picture than one be 
tains in the other need areas and emph 
the point that one has somewhat diffe eds 
measurement problems with relatedness AE 
than with others. Items 15 and 16, A Ri 
with using one's approach at work, turne 

to load with the Desire for Respect 

Superiors items rather than with the Gion : 
items as originally expected. They peel oh 
relatedness loading pattern, too, of hig » 


s : ant 
appeared in both the “more” and low on the “import 
TABLE 4 
SATISFACTION ScaLe MULTITRAIT-MULTIMETHOD MATRIX 
Questionnaire (п = 302) Interview 
P FB RS RP G р FB RS RP ii 
ee TEN 
Questionnaire | 
Р (.88) 
ЕВ 00 (.80) 
RS 01 00 (в) | 
| 
RP —.02 00 00 (.79) | 
G | =й 9 02 os (з, | 
ne 
(n = 111) | (и = 75) 
„== 
Interview 
P SIS AF (.90) 
FB A3 —.12 :09 23 (.90) 
RS 22 —.04 —.13 21 19 10 (.91) 
RP їз o EFI 24 as | 00 07 A6 (84) 
G I a9 2 о) 05 (о) | аз опо олт ло (87) 
= | = — 
a lity diagonal is indicatea pr (C E Seb AlE als by the entries in parentheses, _ 
Constraints of time aie ey heii cocte To be scored by both eodera, The diagonals dr ipa Nesey 
interview sub matrix are based on y 75, the number of intervie 


on the coder who did all the intervie 
Abbreviations: P = Рау, ЕВ = 


ЭН = рр 


tinge Benefits; RS 


lone by both coders, All of the other interview бе, ace paset 
опе s. 


Respect by Superiors: RP = Respect by Peers; G = Growth. 
= Respe t si 
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VALIDATION OF SATISFACTION AND DESIRE MEASURES ole 
TABLE 5 
Ratinc-ScaLe DESIRE [TEMS Factor ANALYSIS 
— n ; = ———— - 
Varimax factors 
Hes Fringe | Respect | Respect 
| Pay Benefits by Supe- К с Growth 
| riors 
1. Good pay for my work—important 07 15 —.07 —.02 .08 
2. Good pay for my work—more 64 8 19. ‚1 24 
3. Frequent raises in pay—important 68 33 .06 —.16 —.01 
4. Frequent raises in pay—more 72 08 ES .03 10 
5. A complete fringe benefit program—important 25 72 —.08 —.04 .01 
OA complete fringe benefit program—more 16 61 227 43 .18 
7. Frequent improvements in fringe benefits—important 26 60 -42 PAG .09 
8. Frequent improvements in fringe benefits—more _ 34 53 37 31 11 
9. Consideration and understanding from my boss—important —.24 05 OL 16 27 
10. Consideration and understanding from my boss—more .14 | —.0t 79 18 .16 
11. Mutual trust with my boss—important 04 08 .07 10 40 
12. Mutual trust with my boss—more 14 03 J3 20 09 
13. Being given recognition for my efforts when deserved— 
important 22| —.02 28 —.08 
14. Being given recognition for my efforts when deserved —more 16 | —.06 68 —.03 
15. Being able to use my own approach on the job—important —.10 A8 33 14 
16. Begin able to use my own approach on the job—more 03 16 66 .23 
17. Cooperative relations with my co-workers—important 15 36 —,34 31 
18. Cooperative relations with my co-workers—more 02 | —.08 3 A6 
19. Respect from my co-workers—important | 45 —.08 —.24 .02 
20. Respect from my co-workers—more | 07 .00 29 —.01 
21. Making full use of my abilities at work—important | —.05 21 11 .61 
22. Making full use of my abilities at work—more 01 06 A8 60 
23. Developing new skills and knowledge at work—important .21 | —.02 —.05 01 76 
24. Developing new skills and knowledge at work—more 27 06 442 21 66 
25. Being challenged by my work—important 04 05 .02 .02 71 
26. Being challenged by my work—more .00 04 24 18 72 
27. Opportunities to invent and explore new ways of doing the 
job—important 17 30 01 32 30 
28. Opportunities to invent and explore new ways of doing the _ 
job—more 14 171 33 .55 27 


Note.—The highest loadings on each factor which are used to define the factor are italicized. 


aspect. Items 27 and 28, dealing with in- 
venting and exploring on the job, did not 
load highly on any of the factors. They had 
been expected to be part of the Growth factor. 
Table 6 gives the median correlation. and 
number of items for each desire variable 
measured by rating scale. Table 7 presents 
the correlations between the two Interview 
Coders for each of the desire measures. 

Table 8 gives the e quee ае ша 
matrix for rating-scale and eee ae 
measures. The median Айде чы pes 
Coefficient is .77; the нар ee vana re- 
interviews is .76. Two 01 ed Repe by 
liabilities—Fringe Benefits h relatively low 
Peers—are quite low. with the y 


reliabilities one would not expect to find high 
coefficients on the validity diagonals, and, in 
fact, this is what the data show. None of the 
entries on the validity diagonal is very high; 


TABLE 6 


RATING-SCALE DESIRE Measures: NUMBER or ITEMS 
AND MEDIAN CORRELATION 


Factor | 


No. items | r 
Pay | 4 | 45 
Fringe Benefits | 4 | ET 
Respect by Superiors 4 .56 
Respect by Peers | 2 „52 
Growth | 6 43 


Note.—N = 176. 


1 
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TABLE 7 
Interview Desire SCALES: INTERCODER 
CORRELATION 
Scale r 
Pay 79 
Fringe Benefits 61 
Respect by Superiors -66 
Respect by Peers .61 
Use Skills and Abilities 51 
Learn Skills and Abilities 54 
Note,.—N = 75, ES К 


Шеге is little evidence of convergent validity. 
Only the Respect by Superiors coefficient 
meets the first criterion for discriminant va- 
lidity; it is higher than any other entry in its 
row and column. It also meets the second 
criterion for discriminant validity in that it 
is higher than any correlation between it and 
other traits measured either by interview or 
by questionnaire. In Eeneral, Desire for Re- 
spect by Superiors is uncorrelated with other 
traits. It is, thus, the only trait for which 
discriminant validity can be established by 
rating-scale and interview methods. 
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A fully counterbalanced paired-comparisot 
method was also used to measure oer 
The first four variables were the im 
the preceding analysis. However, po 
analysis the desire to use skills and a dis 
and the desire to learn skills and CCS 
were expected to be separate scales. Hine 
are reported separately in Table pa i 
ever, in order to be consistent with t | pee 
ceding analysis, a desire for growth sca qu 
developed by adding together these two иа 
scales; their correlation is .53. They арр 
as a single scale in Table 10. ions 

Table 9 presents the split-half ogee 
for each of the paired-comparison awit 
measures. When the correlations are edian 
formed into reliability estimates, the ™ t 
= at 


5 A seventh scale was included in the uon n 
reduce interscale bias, This scale was job edt i 
addition, the format of the paired comparis 
not require an 5 to choose which item W' ^ 
important than the other. He also had the e 
of selecting a third alternative, neither SR th 
more important than the other. In ease 
choices for each alternative, one-half was 81 


t 
; indifferen 
each item when S indicated that he was in 


between the two. 


TABLE 8 


DzstRE-RATING-SCALE MULTITRAIT- 


MULTIMETHOD MATRIX 


Questionnaire (n = 176) Interview 
Р FB RS RP 6 P FB ms RP б 
Eu ee LEE з= MEM шшр 
Questionnaire 
P (77) 
FB .00 (47) 
RS .00 .00 (.84) 
RP .00 .00 .00 (.68) 
G .00 .00 .00 .00 (.82) 
(n = 58) (n = 75) 
Interview 
P @ i м o оз (.88) 
FB 9 бу) о см A 09 — (76) 
RS 00 .02 —À1$ —.10 4  —.02 (.80) 
RP 2202 8  . 10 C —02 A0 02 42 (76) 
á JR x un d 04  —03 08 оз (60) 


Note.—See Note of Table 4, 
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ТАВІЕ 9 
SrLiT-HaALr CORRELATIONS. FOR РАІКЕр-СОМРАКІЅОХ 
IMPORTANCE MEASURES 


Measure r 


Pay 
Fringe Benefits 


Respect by Superiors 89 
Respect by Peers 86 
Use Skills and Abilities 84 


Learn Skills and Abilities .80 


Note.—N = 138. 


value is .93. This is considerably higher than 
the median reliability of the comparable rat- 


ing-scale measures. р 
Table 10 gives the multitrait-multimethod 


matrix for the paired-comparison question- 
naire and interview. Like the rating-scale соеї- 
ficients, none of the values is very high, al- 
though their median value is .22, compared to 
.03 for the rating-scale procedure. With .35 
and .37 coefficients, respecitvely, one could 
suggest that there is limited evidence for 
convergent validity in benefits and growth 
scales. 

'The Pay, Benefits, Peers, and Growth traits 
are higher than any entry in their respective 
rows and columns where neither trait nor 
method is common. These four scales, there- 
fore, meet the first criterion of discriminant 
validity. Additional evidence for the dis- 
criminant validity of these scales is partially 
blocked, however, by the property of the 
paired-comparison scales that when ап S 
chooses one item in a pair he automatically 
Chooses against another item. Correlations 
among the scales are thus developed arti- 
factually. There is an identifiable pattern 


among these correlations found in the ques- 


tionnaire-questionnaire section of Table 10. 


Pay and Fringe Benefits correlate positively 
With each other but negatively E I 
by Superiors, Respect by ree аш эз я 
The Respect БУ Superiors a -— у 
Peers scales correlate | positively with each 

entially zero relationship 


ve ess NS 

other еа, ted scale. Off-diagonal entries in 

= ae portion of the matrix tend to ap- 
е othe 


proach zero- 


~ 


DISCUSSION 


'The results of this study have implications 
{ог two general issues. One deals with the 
measurement problems associated with the 
traits under consideration in the investigation. 
Which variables have the greatest validity 
overall? What implications for research de- 
sign does this have? The second point per- 
tains to what the results say about the inter- 
view versus questionnaire controversy. To 
what extent can one say that one method is 
more effective than or equivalent to the other? 

With the possible exception of the Respect 
by Peers trait, the reliability and convergent 
and discriminant validity of the satisfaction 
scales are quite high. Respect by Superiors 
has the highest convergent validity coefficient 
and it is quite closely followed by Growth. 
When there tends to be zero correlation 
among variables, as there was in this study, 
a high convergent validity coefficient is tanta- 
mount to high discriminant validity. But the 
same uncorrelatedness among variables makes 


TABLE 10 


DESIRE PatgED-CoMPARISON Sus MULTITRAIT- 
MULTIMETHOD MATRIX 


Questionnaire 
(n = 138) 
P ЕВ RS ЕР © 

Questionnaire 
P (.93) 
FB 132 (94) 
RS —48 —44 (94) 
RP —42 —.33 А43 (93) 
G —44 —.50 .07 .06  (.90) 

(n = 50) 
Interview 
P Оў 6 —18 —.14 —.10 
FB =.06 (3300 02 —23 
RS Ol 32 =10 бй 
RP —a7 оз +68 (23) —.06 
© от —14 07 —31 (39) 


Note.—See Note of Table 4. The Interview-Interview entries 
would be the same as in Table 8, so they are not repeated here, 


518 CLAYTON P. ALDERFER 


it possible to attain discriminant validity 
when convergent validity is not high. This is 
what happened for the Satisfaction of Respect 
by Peers trait. A possible explanation for the 
low convergent validity of Respect by Peers 
satisfaction is suggested by the fact that some 
managers, when asked about their co-workers, 
spoke about their subordinates. It was pos- 
sible to rephrase an interview question to ob- 
tain the desired data, but this, of course, 
could not be done for their filling out the 
questionnaire privately, 

The reliabilities and convergent and dis- 
criminant validities of the desire scales were 
generally lower than for the satisfaction 


Strong because of the low convergent validity, 
r would recommend 


tistical properties, but because of the frustra- 
tion and mistrust it Causes among respondents. 
The rating-scale method was introduced into 
the study to find a less alienating method for 
obtaining data on desires, 

Why the generally low validity of the de- 


Sire scales? Are there ways this might be im- 
proved? Respondents fre 


holding lower-skil] jobs 
learn quite a bit abo 


questionnaires had to be discarded for un- 
answered desire items than for omitted satis. 
faction items. This was more true for the 
paired-comparison items than for the rating- 


scale questions, but the statement applies to 
all desire measures. . 

Recall the pattern of factor loadings for 
the rating-scale desire factors in the interper- 
sonal need areas. While both the "important 
and “more” items loaded heavily on their E 
spective factors for existence and ur be 
needs, only the “more” items loaded on De- 
Desire for Respect by Superiors and the га 
sire for Respect by Peers factors. For pers 
interpersonal needs, people apparently do a 
consistently say the factor is important he _ 
they say more is desired. Some of the 
namics of this phenomenon are underlined ih 
the behavior of one particular S, During - 
interview he described a rather lengthy pe 
of difficulties which he had with his boss, к 
Spontaneously and when specific aee 
were asked. His questionnaire reflected Thé 
lack of Tespect he felt from his superior. » 
desire items on his particular instrument iine 
of the paired-comparison type, and not P ih 
did he select "understanding and trust Ня 
your boss” as being important to him. But 
Wrote the following note on the last page 0 
his questionnaire: 

Supervision has to be improved in order for us to do 


1 $5 y s ions 
a better job. This is In reference to all those ques 
Pertaining to “understanding and trust from У! 


boss,” 

The paradox of this event is that while his re 
lationship to his boss was not “important” ac- 
Cording to the way he filled out his question 
naire, it was important enough to deserve ĉ 
special hand-written note on the inue 
Very few people Wrote anything extra on t t 
questionnaire, The point is to suggest Шш 
some measures—particularly those which a5 

directly about importance in interpersona 
areas—appear to become less valid the = 
the person is experiencing difficulties in th 

area, 

Since the "important "scales do not seem 
to work well to measure interpersonal desires; 
9ne could simply include a greater number a 
the “more” items for these areas. This is fo) 
lowing the principle of test theory that as 
can increase the reliability of his test by — 
ing it longer. A similar point can be applie 
to the interviews, which were not very long 
anyway. It is not unusual for interyjews tO 
last 2 and 3 hr. in behaviora] Science re- 
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Search. Longer interviews would allow for 
More issues to be raised spontaneously and 
for a greater sense of trust to develop be- 
tween interviewer and respondent. 

Perhaps the issues raised spontaneously by 
Deople in the interviews are not fully con- 
scious desires. They may be more accurately 
termed preconscious desires. If this is true, it 
Provides a partial explanation why the inter- 
view measure did not correlate highly with 
the more fully conscious questionnaire mea- 
Sures, while at the same time they did show 
evidence of discriminant validity. One might 
Consider the possibility of using projective 
lechniques to tap the desire variables: they 
could be used in both interview and question- 
naire frameworks. 

A subject not touched by this report is 
construct validity. How well do the different 
measurements confirm theoreticallv derived 
predictions? The instruments were developed 
to test predictions from a theory. In data al- 
ready available, results show some, though not 
all, of the predictions are supported (Alder- 
fer, 1966). Questionnaire variables relate to 
other questionnaire traits; interview measures 
to other interview scales; and questionnaire 
measures to interview variables. Replication 
of those findings is being undertaken. But 
even as the data stand now, thev strongly 
suggest that questionnaire methods can be 
used to replicate interview results. and vice 
versa. 

Particularly in approaching the interview 
Versus questionnaire controversy, one would 
want to ask if the results of the study can be 
accounted for bv design or demand charac- 
teristic artifacts. Each interview was carried 
Out before the questionnaire was completed. 
There were anywhere from a few days to a 
few weeks lag between when a respondent 
had his interview and when he returned his 

i ire by mail to the writer. Since the 
Questionnaire Dy 
; = : open-ended and the 
interview questions Were р е 
А ; i fixed-alternative, a re- 
questionnaire items d 
па have to have a remarkable 
Spondent wou dge of the concepts of 
and knowledge г 
| r to produce correlated re- 
nts simply to ap- 
and/or the eyes 


memory 
the study in order t 
sponses on the two instrume 
pear consistent in his own 
of the investigator. 
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The questionnaires were analyzed prior to 
the interviews, and both analyses were done 
blind so that neither questionnaire nor inter- 
view coder knew what the S's other instru- 
ment scores had been. Furthermore, factor 
scores were used in most of the correlations; it 
would be quite an effort and ability to de- 
velop factors which are as clearly interpretable 
as those in this study through conscious or 
unconscious bias. 

The results do more to answer the objec- 
tions of those who say that interviews cannot 
be done systematically than they do to meet 
the points raised by those who say that ques- 
tionnaires alienate respondents and thus foster 
invalid data. The respondents had met from 
a minimum of 20 min. to a maximum of an 
hour and a half with the researcher prior to 
being asked to do the questionnaire. They, 
thus, had had an opportunity to express their 
views in their own way and had less reason to 
feel exploited than people just asked to fill out 
a questionnaire. 

Because it allows for more choice and initia- 
tive on the part of the respondent—without 
apparent loss of validity—the interview has 
much to recommend its being used in con- 
junction with questionnaires when the pos- 
sibility following the study with organiza- 
tional change activities exists. In time and 
dollar economics more data can be obtained 
per unit of output by using questionnaires. 
When interviews can be used in conjunction 
with questionnaires, there exists the pos- 
sibility of reducing respondent-researcher 
alienation and thus increasing the validity of 
the questionnaire data. 

The interview versus questionnaire con- 
troversy recalls the “two disciplines of psy- 
chology” described by Cronbach (1957), The 
disciplines were not bipolar but two dimen- 
sional: qualitative-quantitative being опе 
dimension and correlation-experiment being 
the other. When essentially orthogonal issues 
become polarized, one can infer that emotional 
as well as intellectual issues are at stake. A 
report such as this which deals with the in- 
tellectual aspect is a limited contribution to 
the conflict. 
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SELF-ESTEEM OF INDUSTRIAL WORKERS 


JOEL LEFKOWITZ 1 
Baruch School, City College of New York 


The Bills Index of Adjustment and Values (IAV) was used to obtain measures 
of self-esteem for a sample of 153 factory workers. The workers’ self-esteem 


was significantly hi 


her than college students' used as a standardization grou 
g! group 


for the IAV. Self-esteem proved unrelated to a variety of job-related variables. 
Married workers demonstrated greater self-esteem than unmarried. Those with 


some college experience demonstrated 
a high school education. Employees who 
significant chang 
was presented wh 
readily to survey 


greater self-esteem than those with only 


had to change their jobs demonstrated 


es in level of self-esteem following the job change. Evidence 
hich suggests the possibility that those employees who respond 
-research inquiries are lower in personal and job adjustment 


than are those who choose not to respond. 


Since the industrial revolution, the worker 
has been successively defined by industry as 
motivated primarily by concern for physical 
comfort, economic success, the most efficient 
use of his talents, and emotional well-being 
(Brown, 1958; Herzberg, 1966). The pre- 
vailing contemporary view is that man is 
characterized by an ultimate goal to fulfill 
inherent potentialities and to gain some 
measure of competence over his environment. 
This “self-actualization” motive has been 
applied extensively to industrial life. Research 
indicates that one's job is potentially the 
greatest source of satisfaction or frustration 
of this need (Friedmann & Havighurst, 1954; 
Gurin, Verofí, & Feld, 1960; Levenstein, 
1962). 

Rarely made explicit is the importance of 
the individual's apperception of the extent 
to which he is “self-actualizing,” as reflected 
by his feelings of self-esteem. Self-esteem is 
that organized and evaluative aspect of self 
which develops as a result of holding oneself 
up to scrutiny as an object in one’s own 
cognitive world. This study is based upon 
the assumption that one’s feelings of self- 
esteem are determined largely by — 
ment stemming from one’s performance 0 
his job, and from interpersonal relations on 


the job. 
PROBLEM 
self-esteem were obtained for 
Measures © qustrial workers in order to 


a sample 0 


BFS psychological Associates, Inc. 
t 
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ascertain the distribution of scores of this 
variable for such a sample. A standardized 
measuring instrument was used in order to 
enable intra- and intergroup comparisons. 

The second major purpose of the investiga- 
tion arises from what has been called “an 
environmental approach to mental health in 
industry” (French & Kahn, 1962). The rela- 
tionships between several job and demo- 
graphic variables and level of self-esteem were 
analyzed. 

Ever since the pioneering work of Coch 
and French (1948), workers’ reactions to 
change have been shown repeatedly to be 
based on perceived threat (Mann, 1962; 
Marrow, 1949; McMurry, 1946; Schachter, 
Willerman, Festinger, & Hyman, 1961; Selek- 
man, 1962; Shils, 1963; Trumbo, 1961; 
Walker, 1950). If one accepts the assumption 
that a man's job constitutes an important 
developmental and confirmatory source of 
many aspects of his self-concept, then it 
seems likely that these feelings of threat 
derive, in part, from the perception of threat 
to the self. 

It was predicted that those employees who 
are moved to a different job would manifest 
significant changes in level of self-esteem 
(measured without regard to direction of 
change). 

Directional changes were not predicted be- 
cause we are interested primarily in noting 
whether or not an association exists between 
job change and change in level of measured 
self-esteem regardless of the positive or nega- 
tive nature of that change. In addition, while 
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ТАВГЕ 1 


DEMOGRAPHIC CHARACTERISTICS OF THE SAMPLE 


Characteristic M | SD 
Age (years) 47.5 6.95 
Company seniority (years) 21.7 5.20 
Base rate of pay (cents/hr) 312.08 | 28.75 
Education (highest grade completed) 11.25 | 1.42 


Note.—Preliminary statistical tests revealed no significant 
differences between men and women on all of the major vari- 
ables involved in the study. Data from men and women were 
therefore combined, N = 179; 144 males, 35 females. 


the predominant reaction to job change is 
the perception of threat and attendant self- 
devaluative feelings, some individuals may 
manifest a defensive increase in self-esteem 
Scores. Bills (1953) and Thorne (1954) 
note that self-devaluative feelings may result 
in increases in measured self-esteem among 
those who are initially low in measured self- 
esteem. 


МЕтнор 
Research Site and Sample 


The study was conducted within two manufactur- 
ing divisions of a midwestern plant each of which 
employed approximately 275 hourly workers en- 
gaged in the manufacture of 
motive, aircraft, and missile Products. Of the 549 


because of the necessity of using a direct-mail 


‚ Table 1 summarizes some demographic 
characteristics of the sample. 


Measures 


Self-esteem was measured by th 
Adjustment and 


ual; Bills, Vance, & McLean, 


1961). 

The odd-even reliability of the self- 
was .92 (with Spearman-Brown Corre: 

Job satisfaction was measured by summing the 
Tesponses to 30 Likert-type questions with 5 alter- 
natives. The individual items Tepresent 10 areas of 
job satisfaction which have been identified as sub- 


2 Twenty-four individuals neglected to fill out 
the Bills Index of Adjustment of Values, so that 
the self-esteem data are based upon an W of 155, 


esteem ratings 
ction), 
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suming all of the research results in this area with 
a minimum of overlap (Herzberg, Mausner, Peter- 
son, & Capwell, 1957). ч = 

The "m reliability of the job-satisfaction 
questionnaire was .89 (with Spearman-Brown ys 
rection). The mean item-total correlation for t 
30 questions was .56 (SD = 18). —€—— 

During the course of the investigation it wa 
recognized that the job-satisfaction items were eH 
cerned predominantly with extrinsic job d 
Therefore, a separate job-satisfaction соге ys 
computed for the five items which related ; 
intrinsic job factors. Herzberg's (1966; genie 
Mausner, & Snyderman, 1959) conceptualization T 
“motivators” was utilized to define the intrinsi 
items. 

Employees’ attitudes toward work-related ар 
Were measured by means of a change scale ta т 
from Trumbo (1961). The scale consists of oe 
questions designed to measure generalized attitude: 
toward work-related change. + jobs 

The respondents? ego involvement in their J B 
Was measured by summing the responses to ema 
questions. The first question is based on pos 
reported by Slater (1960) and Vroom d 
utilizing Zeigarnik’s work regarding recall of п 
completed tasks. The question asks, “If a prob x 
comes up in your work and it isn't all settled il 
the time you go home, how likely is it that you ive 
find yourself thinking about it after work? in 
second question is similar to one used by GI 
et al. (1960). The Ss were asked “What Wo 
do you particularly like about your job?" by 
write-in responses were scored independently he 
three judges for degree of ego involvement. s 
third question required the respondent to rank тақ 
areas of his life in their order of importance to ae 
These were family, job, hobbies and Ieisure-H1 
activities, friends, and religious life, The Ss’ score 
Were determined by the rank assigned to the Jove 

Computation of both inter-item and item-tott 
correlations indicated that the three questions uos 
statistically independent, suggesting that "job ias 
volvement” is a multidimensional trait, This ар, 
With results reported by Lodahl and Kejner (19 tie 
Subsequent to the initiation of the present і 
vestigation. ay: 

Skill level was estimated by base rate of P ies 
Base rate excludes from consideration all bonta 
such as allowances for working second or 
shift. m- 

Attendance was measured by summing the e 
ber of times an employee was absent aurin a 
previous calendar year. An absence of more t med 
day’s duration was counted as 1. It was яе » 
that this measure would be a rough indicat. а 
attitudinal factors leading to а temporary © 
drawal from the work situation. А {һе 

The total number of voluntary visits t° year 
plant dispensary during the previous calenda! ig- 
Was noted. Kasl and French (1962) repor 
nificant relationships between the tendency : 
medical aid and to report physical symptom 


seek 
wi 
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skill level, self-acceptance, and a self-report measure 
of stress. 


Procedure 


Teens questionnaires were mailed directly to the 
ке of the respondents. A return envelope ad- 
Mesi to the investigator at Western Reserve Uni- 
to tho was enclosed. Follow-up letters were sent 
B ose employees who had not replied within 2 wk. 
Wher te of the nature of operations at the factory 
to s research was carried out it was possible 
Жа minister the questionnaires to 19 employees 
ones МЕБ. “bumped” {0 different jobs from the 
in which they were situated at the time of 
з, administration of the questionnaires. 
NE de contracts at this factory run ior approxi- 
uvis 6-16 mo. with the possibility of extension. 
infre g to change one’s job is, therefore, not an 
ОК event. These changes are accomplished 
whic the company’s plant-wide “bumping ? system, 
dae Seeks to accommodate the entire plant's overall 
Dower requirements. 
due ay a Particular job is discontinued (usually 
that © termination of a contract), the occupant of 
PO may move to the same job in another 
next жеры If none is available, he moves to the 
ereby west Tanking job for which he is qualified, 
Wide т “bumping” the man with the lowest plant- 
tinues eniority on that job. This man, 1n turn, con- 
be «l € process and many men may eventually 
mor реч.” This continues until, if there are 
seniorit * displacements possible, {һе man with least 
Which У is laid off. A plant-wide bump sheet 
lists all necessary moves is printed daily. - 
thi Control group was obtained by readministering 


e 

Questionnai 4 z Љо had re- 
Maj nnaires to 42 employees W 

ji ed the period of 


Stat; 
Glistica] Treatment 
The ma, was treated by 
lished through 
& Haynam, 
which is 


тшн, jor portion of the data 
the ц €-regression analysis accomp 
l96q) of MURA (Hammer, Hansen, 
design yt, Stepwise computer program 
Shed to handle up to 61 variables. 


P RESULTS 
řeliminary Checks for Possible Sample Bias 


Because only 33% of those questionnaires 
Гей were returned, the possibility exists 
i: Systematic “self-selection” effects have 
ased the sample. 
е difference in mean seniority between 


p d the population 
f mple (21.7 yr.) and 
E which it was drawn (21.2 yr.) was not 
&hifican t 
e here is, of course, no data wi 
tho, Major variables involved in th 
Se employees who did not resp 


th respect to 
e study for 
ond to the 
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questionnaires. However, of the 179 employees 
who did respond, 63 did so only after re- 
ceiving a follow-up (reminder) letter. This 
group may be used to approximate a group of 
“nonrespondents.” It is possible that those 
who were reluctant to answer questionnaires 
differ significantly on relevant variables from 
those who responded readily. 

Table 2 shows that results for five of the 
six variables were not significant, suggesting 
the absence of self-selection bias. However, 
there is a tendency for the follow-up re- 
spondents to be on higher-paying (more 
skilled) jobs, and to demonstrate greater job 
and personal adjustment. The possibility 
therefore exists that this trend is more pro- 
nounced among those who were most reluctant 
to answer the questionnaires—that is, those 
who chose not to respond at all. 


Correlates of Self-Esteem 


In order to ascertain the degree of as- 


sociation of each of the independent variables 


TABLE 2 
COMPARISON OF “Barty” RESPONDENTS WITH THOSE 
Wuo RESPONDED ONLY AFTER RECEIPT OF 
A Fottow-Up LETTER 


Early Follo 
Follow- 
Variable E is t 
w = 116)| © = 63) 
f-Esteem* 
SR ры 179.62 183.15 z 
SD 26.70 23.56 
Satisfaction 
Jo atisfa РРР" RUM ү 
SD 16.70 16.28 
ob Satisfaction 
“Motivators” 
Xx 15.40 1694 |5g9 
SD 3.45 3.71 á 
Attitude toward Work- 
Related Change 
Ed 29.37 8046 | „. 
SD 6.22 5.74 
Ego Involvement in Job 
X 32.27 33.59 | е 
SD 5.32 6.01 
Base Rate of Pay 
cents/hr) 
x | 309.84 | 316.21 |, 
SD 28.80 28.67 
» Due to missing data the Ns are 101 and 54, respectively, 
for this variable. 
01 (df = 177). 


ар <) 
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TABLE 3 
Step-Wisr MULTIPLE REGRESSION ON LEVEL or SELF-ESTEEM 


Regression coefficients Constant} р 
term 
t 
Es s | 7 8 9 10 1 
acd Е MERETE 6 7 £ E. — 
| | 167.68 п 
1 | .83 | | 1e "ig 
2 .82 | .04 | 132.59 3 
3 .69 04 98 127.61 .20 
4 .65 04 .10 89 128.39. Ml 
5 |.6 | 05 | 08 | .93 | 109 (3342. | 32 
6 | .67 | 05 | .09 | 1.01 | 124| —.29 14259 | 22 
7 | 66 | 04 | 09 | 94] 132 | -35 : моз; | 23 
8 65 05 .09 83 | 1.067] —.29 —.17 | 147.01 23 
9 | 63 | 05 | 09 | аз|112| 30 =16 | 10 | mS. a 
10 | .55 | 05 | .09 | .82 | 116 | —29 E | эш) D в | 14533 | .23 
й | 455 | 405 | .09 | 8$ | {15 | —29 —.17 | ло | .03 кай p dew | 2 
в ов | a3 “10 7 | 07] —07 | —05 | —os | 02 0%] oi 
| | i 
Note.—N = 155. 


with level of self-esteem, a step-wise multiple- 
regression analysis was performed (see Table 
3). The order of addition of the independent 
variables was determined, at each step, by 
which of the remaining variables would con- 
tribute most in explaining the total variance 
in self-esteem scores. The B-weights corre- 
Sponding to the regression coefficients when 
all 11 independent variables are entered into 
the equation are also presented. The order 


of addition of the independent variables was 
as follows: 


1. Job-satisfaction “motivators,” 
2. Seniority. 
3. Base rate of pay. 
4. Absences. 
5. Number of dependents, 
6. Attitude toward work-related change. 
7. Education level. 
8. Age. 
- Ego involvement in job. 
Overall job satisfaction, 
11, Dispensary visits. 


lysis does R approach 
a significant value, It i 


tion of them, accounted 


The absence of significant с 


orrelations is in 
contradiction to a body of 


research which 


" tion- 
Supports the existence of a positive an 
ship between job status and вена. 
Ог mental health (French, So алг 
French, 1962; Kornhauser, 1965; 
Quinn, 1962). mW 

Men and women did not differ "s 
9n any of the variables considere cot 
esteem, job satisfaction, attitude n one’ 
related change, and ego involvement 1 
job). 

The mean self-esteem score i N 
employees was 181.99 (SD = 25.9 (sD 2 
136) and for single people 167.01 acan 
19.88, N = 12). The difference is sig Je are 
at better than the .10 level. Single PoP fiear 
greatly restricted in achieving the : erson 
tions associated with a deep RCM 960) 
relationship. In addition, Gurin et „анге for 
Point out that the role p ager P 
solitary statuses are much less c Је, 2 d 
lineated than those for married p perd ad 
that this ambiguity probably pee adjust” 
justment problems; we would а d n Јо? 
ment problems which are reflecte 
levels of self-esteem. i el of sel 

There were no differences in ш sh! 
esteem between those working the im third 
(N = 101), second shift (V m Ws worker 
shift (N = 9). However, nage rst-shitt 
Scored significantly lower than di js dis 
workers on overall job satisfaghom |, soci? 
satisfaction probably stems from 


салу 


ied 
mare 


= 
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and familial adjustments that are required of 
those who work at night. All those in the 
Present sample who were working the third 
shift were married. 
" Table 4 shows the mean self-esteem score 
E those employees who have had some col- 
i experience to be significantly higher 
ап that of employees with a high school 
rateation, An overall positive relationship 
уеп level of education and self-esteem 
S not implied, however, because grade school 
Staduates also scored higher than high school 
Stites (although the difference is not 
atistically significant). 


Change in Level of Self-Esteem following Job 
hange 


oon 5 shows that those employees who 
nifi erwent job changes demonstrated sig- 
s cantly greater changes in level of self- 
ch fem (without regard to direction of 
ane than did the control group who 
“ctwent по job changes. 
айа], expected, when the change scores are 
Siege algebraically, positive and negative 
ing ges tend to cancel each other out result- 
A^ nonsignificant mean differences. 
Сап difficulty in interpretation arises be- 
dire; anges in self-esteem scores In the 
i Ctions predicted and actually observed 
Ае. lowered scores for those initially high 
o, esteem and a defensive rise in scores 
Stit those initially low in self-esteem) con- 
fest, e changes which one would predict upon 
ministration of any measuring instru- 
“nt. That is, we expect а regression toward 
reli population mean upon retest due to un- 
"ol, lity of the measure even for the con- 
Broup, 


TABLE 4 


Зекетке Scores or EMPLOYEES DIFFERING IN 
LEVEL or FonwAL EDUCATION ATTAINED 
Level of education M Ж ой e 
Pd school (ninth grade and | 182:93 | 19:24) 14 
"b shoot (tenth-twelfth | 180-14" | 26.71 | 133 
College (enrollment for any | 189-50] 14.08) 8 


ength of time) 


Meri (b <.10). 


TABLE 5 


CHANGE IN LEVEL ОР SELF-ESTEEM 
FOLLOWING JOB CHANGE 


Group Moist SD t 
Experimental 
W = 19) 18.00 | 13.41 
2.34* 
Control (no job change) 
(N = 42) 12.95 11.24 


Note.—Change scores computed without regard to sign. 
*p <.05. 


However, the interpretive task is facilitated 
if these changes are significantly greater for 
the experimental group than for the control 
group. The relevant regression equations in- 
dicate that this is so. The regression of change 
in self-esteem following job change on initial 
level of self-esteem is given by the equation 
Үр = 120.84 —.661X. The regression of 
change in self-esteem on initial level of self- 
esteem for the control group (no job change) 
is Ур = 40.02 — .206X. The difference be- 
tween the two slopes is statistically significant 
(t= — 1.83, р < -10). 


DISCUSSION 


The theoretical position which holds that 
the individuals job is a significant deter- 
minant of self-concept variables has been 
rather devoid of “hard” data substantiating 
that position. Self-concept theory holds that 
almost any interpersonal experience can re- 
sult in the incorporation of some aspect of 
life into the self-hood. Particularly relevant, 
it is felt, is one’s work experience (Allport, 
1937). 

Tt appears that the weakest part of self- 
concept theory is with regard to explaining 
how the various relevant aspects of one’s 
psychological environment get incorporated 
into the self. Rogers (1951) is the most 
specific on this matter: 

Whether or not an object or an experience is 
regarded as part of the self depends to a con- 
siderable extent upon whether it is perceived as 
within the control of the self. Those elements 
which we control are regarded as a part of the 
self, but when even such an object as a part of 
our body is out of control, it is experienced as 
being less a part of the self [p. 497]. 
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In terms of self-concept theory, job change 
is, therefore, perceived as threatening be- 
cause of its signifying loss of control over a 
vital aspect of one’s life. o 

The present finding, indicating significant 
changes in level of self-esteem following job 
changes, demonstrates the functional depend- 
ency of self-esteem on vocational variables. 
While the small sample size involved does 
serve to limit possible generalizations, con- 
siderations exist which lend added significance 
to the findings. 

Having to change one's job is a relatively 
frequent and expected occurrence at the fac- 
tory in which this research was conducted. 
We would expect the differential effects on 
similar experimental and control groups to be 
more clearly delineated within a population 
where change is not such a common and 
expected occurrence. 

Second, the measure of self-esteem em- 
ployed in the study is a standardized person- 
ality instrument, developed within the theo- 
retical framework of nondirective counseling. 
The important fact is that the adjectives 
which comprise the ТАУ are not at all job- 
related. For job change to have resulted in 
significant changes on such a measure in- 
dicates the potency of circumscribed job 
variables in affecting basic personality char- 
acteristics, 

The similarity of the regression equations 
presented emphasizes the necessary utiliza- 
tion of a control group in longitudinal re- 
search. The fact that the same directional 
changes are noted in both the experimental 
and control groups leads us to ascribe a por- 
tion of those changes as due to a regression 
of scores toward the population mean. How- 
ever, the fact that the difference between 
the slopes of the two regression functions is 
statistically significant indicates that the 
changes in level of self-esteem following job 
changes cannot be accounted for totally on 
this basis. It appears that the statistical 
regression effect and the psychological effects 
are additive. 

The mean self-esteem score for the sample 
of 155 industrial workers was 180.88 (Sp 
— 25.63). This is significantly higher (ф< 
01) than the mean score of 1,728 college 
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students used as a standardization group for 
the IAV (Bills, undated manual). s 
The higher self-esteem scores of the U^ 
dustrial sample are probably related to ёг 
age differential between these groups, x al 
than to the difference in educational level. 
The industrial sample is a middle-aged pend 
Whose members have passed the major soci с 
and vocational crises of life. As опе pem 
into middle age, major psychological a hee 
ments are achieved, especially in terms 0 sii 
creasing congruity between aspirations gs 
attainments. This increase in congruity d 
sults in greater self-esteem (acceptance 
self). А 
н ЧИ of the ТАУ to other een 
tional groups would be necessary to de ely 
mine whether our factory sample is ipae 
high or low in self-esteem when comp p 
with other vocational categories. The du 
evidence (Kornhauser, 1965) suggests than 
factory workers are lower in self-esteem uibs 
comparable groups (utilizing a more 5 
jective, qualitative index than the TAV 
The failure to note significant relations ai 
between self-esteem and the job-related V ay 
ables included in the regression analysis ™ 
be attributed to the homogeneity òf ion 
sample. Table 1 reveals a lack of dispen as 
with respect to pay and educational leve yia- 
reflected in the small sample standard de 
tons of these distributions. Moreover, à 
relatively large standard deviations hare 
spect to age and seniority are mislea al 
because these dispersions are not DoE 
distributed. Only 20 employees of the E 
179 are below 40 yr. of age, and n 
below 30. The lack of dispersion a a 
attenuate any relevant correlation сое "Tr. 
The restriction in range is not due rately 
appropriate sampling, but reflects ^ tory 
the composition of employees at the Man 
in which the research was conducted. ve 16, 
power reductions over the past 10 уг. woe о 
sulted іп a reduction in the total num 0 
hourly employees from approximately study- 
in 1956 to 2,600 at the initiation of the S roy 
This has been at the expense of those Y' 
workers with the least seniority- ect that 
Tn addition, we have reason to pe sy” 
the dispersions of obtained scores оп y 8 
chological measures employed are 4 
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tenuated. In checking for possible sample 
bias, evidence was noted (Table 2) which 
indicates the possibility that the 67% of 
employees who did not respond to the ques- 
tionnaires represent those who might score 
at the upper ranges on the measures used. 

The possibility of such self-selection bias 
has significant implications for the practice of 
industrial survey research in general. It sug- 
gests that nonrespondents may be psycholog- 
ically healthier, better adjusted to their jobs, 
more ego involved in their jobs, better able to 
adapt to changing work situations, and more 
highly skilled than those who respond volun- 
tarily to inquiries regarding industrial psy- 
chological research. One possible interpreta- 
tion is that such research serves as a type of 
"escape valve" for the reduction of tensions 
and anxieties and as a means of expression 
of dissatisfaction with one's job for those 
workers so characterized. The better adjusted, 
more satisfied workers may respond only to 
the extent that they are willing to *cooperate 
in the interests of science." 

Industrial psychologists may be developing 
a discipline based, in large measure, upon 
atypical samples. 
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DECISION MODELS FOR CREDIT SCORING SYSTEM 
CUTOFF DETERMINATION 


JAMES H. MYERS? 


School of Business Administration 
University of Southern California 


Numerical scoring systems for evaluating retail credit risk provide a more ob- 
jective basis for screening credit applications than traditional methods. The 
business firm using a scoring system is faced with the problem of determining 
the cutoff score which will maximize profits per sale, taking into account the 
ratio of good to bad accounts without a scoring system and the profit-loss 
margins on each transaction. This paper presents a solution to this problem 


using statistical decision theory. 


Several publications have discussed the de- 
velopment and use of numerical scoring sys- 
tems for evaluating credit applications at the 
retail level (Myers, 1963; Myers & Cordner, 
1957; Myers & Forgy, 1963; Smith, 1964). 
While research models and methodologies have 
varied somewhat, most investigators have ap- 
proached the problem in a similar manner. 
The objective has been to produce scores or 
weights for various personal-history and fi- 
nancial-background items (e.g., age, time at 
present job, current installment indebted- 
ness) which can be added together to produce 
a single "risk" score—the higher the score, 
the more likely the applicant possesses the 
personal and financial qualifications which 
predispose toward prompt payment of credit 
obligations. 

The typical successful numerical scoring 
system produces results similar to those shown 
in Table 1. These results came from an actual 
study in a personal loan chain in Los Angeles 
(Myers & Cordner, 1957),using accounts which 
had been accepted on the basis of subjective 
evaluation by experienced credit interviewers. 
Table entries were produced by scoring a 
sample of equal numbers of good (paid-up) 
and bad (delinquent) accounts on each of 17 
Personal-history items. Weights used for each 
item were developed from a previous sample 
so that results shown in Table 1 


of accounts, п Tabl 
» estimates of the discrimina- 


are “shrunken 
tion power of the scoring system. 
~ 

* The writer wishes to thank 
University of Chicago, for help in the 
this manuscript. 


nk Harry V. Roberts, 
preparation of 


The score scale shown has been simplified 
from the original scale, which ran from О to 
130 points. 

Since all of the accounts scored had already 
been granted credit on the basis of a subjec- 
tive evaluation, it is clear that the scoring 
system offers some improvement over subjec- 
tive evaluation; for example, by establishing a 
lower cutoff score of 5 and below, 28% of the 
accounts which did not pay could have been 
eliminated at a cost of only 5% of good ac- 
counts. 


Problem 


A major problem in using such a system is 
that of determining the cutoff score below 
which applicants should be refused credit. 
One approach would be to reject those scor- 
ing 3 or below, which would eliminate ap- 
proximately 6% of unpaid accounts without 
losing any good business. But the optimum 
solution is not so simple. It can be shown 
that the most profitable lower score limit is 
much higher than this in some situations; 
that is, the merchant can afford to eliminate 
some potentially profitable (good) accounts 
when by doing so he can eliminate a much 
larger percentage of potentially unprofitable 
(delinquent) accounts. 

In general, there are two factors which must 
be considered in setting the most profitable 
lower cutoff score for any credit situation: 


1. Gross profit margins on transactions. 
Obviously, the businessman would do better 
to set the cutoff higher (ie., refuse many 
more applicants) if his gross profit margin 
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ТАВГЕ 1 
Crepit Scores ОР Goop anp Bap Accounts 
% of good % of bad 
Score accounts* accounts* 
14 
13 i 
12 
11 10 3 
10 14 6 
9 23 9 
8 19 12 
7 13 17 
6 5 25 
5 3 15 
4 2 7 
3 4 
2 2 
1 
ў PS 
100% 100% 
aN = 150. 


were small. In such a situation, he stands to 
lose a great deal (80-90% of sale price) on 
each transaction. Banks are examples of this; 
they risk $100 to gain $6 or $7, in the case of 
short-term personal loans. 

2. Percentage of all credit transactions that 
pay in full (without using a scoring system). 
Referring to Table 1, it can be seen that if 
the ratio of all paid to all unpaid credit ac- 
counts is 1:1, the cutoff score can be set 
higher than if the ratio were 15:1 or 20:1, as 
in many credit operating situations. In the 
latter case, Moving the cutoff up eliminates 
a larger percentage of unpaid accounts but at 
the same time eliminates a far larger number 


of good accounts, on which potential profit is 
lost. 


several texts (Chernoff & Moses, 1959; 
Schlaifer, 1959), 


Decision Models 


Incremental analysis wil] determine the 
point on the score scale where the loss from 


James H. Myers 


rejecting good accounts first exceeds the m 
from rejecting delinquent accounts. For E 
possible score i оп the score scale G (S e 
+++) we can assign a probability P, tha a 
potential customer will have score d and va 
pay, and probability P that he will sco 
and will not pay. Let 


Р. = 25 Pig 
i=l 
k 
Рь= УР, 
il 
Pi = Р, + Pa, i—1,2,-k 


Note that: 


Pot Pan Ф se Pi 
and 


= 1. 


Р» = (P) EP(i| g] 


where 


of 
Pig = joint probability of the occurrence 0 


а “good” applicant and a score "d 
Р. = probability that a loan will be poma 

(.e., proportion of all loans W ing 
аге repaid, without using a E du pU 
System cutoff). This is a "prio 
probability, 

P(i|g) = proportion of good (paid) case 
Which score 4 (from Table 1). 


" nd 
To represent profit for good transactions 2 
loss on unpaid accounts, let 


Mg = gross margin on a transaction which 
pays in full. "T 
Ms = net loss on an account which 
not pay. 


р, 4 
Then we will accept applicants with score 
if and only if 
[11 


Pam, > Pam, 


that is, if 
Pg Ms 
= A =, 
Pin < т, 


; lation 
An alternative, but equivalent, formu 


A t ap 
of the above decision rule is to accep 
Plicants with score i if and only if 


20 
P(g|i)m, > Р(|1)ть, 


MODELS FOR CREDIT SCORING 


where Pli) and P(b|i) are conditional 
probabilities of repayment, given that the ap- 
plicant has a credit score of 7. However, since 


РОР. Р: 
раі = Goes lors. га 
10 Ы d. 


results from inequality, [2] will always be 
proportional to those from inequality [1] and 
the same cutoff decisions will be produced in 
either case. 


Expected Profit 


Perhaps a more meaningful approach is to 
calculate an expected profit from each credit 
sale or loan for each possible cutoff point on 
the score scale. The following model pro- 
duces the same cutoff decisions as those above, 
but has the advantage of talking in terms 
that are more familiar and meaningful to 
the businessman. It also tends to smooth out 
irregularities in score distributions which occur 
when either good or bad cases (or both) pile 
up at a particular score or score interval. 

If we assume, for the moment, that no 
scoring system is used, we have 


k k 
Mg У Pig — my. Pis [3] 


i=l i=l 


Е(т) = 


= MP o — MP w 


where mg, ть, P.,, and Р. are as previously 
defined, and E, (т) = expected gross profit 
on an individual loan of average size, with no 
scoring cutoff. 

For illustration, assume that the following 
values represent the operating situation in a 
personal loan office for a $100 personal loan: 


mg = $ 15 
ть = $100 
Pp, = 495 
Рь = 05 


yields the following ex- 
$100 personal loan for 
tion without using 
payments are 


Then Equation [3] 
pected profit from a »' 
the normal operating situa 
a scoring system (assuming 70 
made on a bad loan): 

E,(«) = (95) (815) — (05) ($100) 
= 14.25 — 5.00 


= $9.25. 


\ 
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If a numerical scoring system is installed 
and used, it will mean that some of the ac- 
counts previously accepted will now be re- 
fused. The problem is one of finding the cut- 
off point which will maximize profit. One 
approach is to calculate the expected profit at 
each cutoff score by a variation of Equation 
[3]. If a cutoff is used, there are two forms 
of “profit”: 


1. Gross margins on good business which is 
accepted; 

2. Losses saved by rejecting bad business 
previously accepted when no system was used. 


Similarly, losses are realized both from bad 
business which is accepted and from good 
business which is rejected when the system is 
used. Expected profit can be calculated by: 


k Lj 
Ет) = т, У, Pu + m È Pi 
i=jH i=l 


j k 
— т, dX Pig — ть 35 Рф; 
pensi 


i=l 


where E; (7) is the expected profit by using a 
scoring system and rejecting all applicants 
scoring j or below. 

As an illustration, the expected profit per 
$100 loan if applicants scoring 7 or below are 
rejected (using Table 1 and assuming 596 
delinquent accounts without a scoring sys- 


tem) is: 
Е(т) = .71 (.95) $15.00 + .70 (.05) $100.00 
— .23 (.95) $15.00 — .30 (.05) $100.00 
= $10.97 + $3.50 — $3.28 — $1.50 
= $9.69. 


In a similar manner, the expected profit can 
be calculated for each score on the scale, as 
shown in Table 2. From this table, it can be 
seen that the expected profit increases from 
$9.25 without a scoring system to $11.70 by 
using the system shown in Table 1 and 
eliminating all applicants scoring 6 or less. 
Thus, the cutoff should be set at 6 or below 
to maximize expected profit. This is the same 
cutoff point as would be determined using 


Equations [1] and [2]- 
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TABLE 2 
EXPECTED Prorit at ЕАСН Rejection POINT 


Reject those scoring Е, (x) 
<13 —9.25 

x12 —8.39 

<и —6.12 

<10 —3.56 

<9 —.18 

<8 5.48 

<7 9.69 

< 6 11.70 

<5 10.62 

<4 9.98 

<3 9.85 

<2 9.45 

<1 9.25 

No system 9.25 

Discussion 


The above analysis does not consider, of 
course, the costs of constructing, installing, 
or administering a numerical scoring system, 
These costs would normally be small in rela- 
tion to the increase in expected profit for a 
large volume operation using a scoring system 
as effective as the one illustrated in this Paper. 

It should be noted that the greater collec- 
tion efforts normally required for those with 
lower scores would change the entries in the 
payoff table to some extent; that is, the 
gain per successful loan would be reduced and 
the loss per unsuccessful loan would be in- 
creased. Also, the $100 loss figure used in this 
paper for a $100 loan is not likely to be ac- 
curate for the practical situation. Usually the 
borrower will make at least some payments, 
thus reducing the loss for the average loan 
below this amount. Entries in the payoff 
table can easily 
dividual company situation. 


James H. Myers 


The analysis presented here was hased 
upon loans of $100. For loans at or near 3 
amount, a linear utility function can Lo n 
sumed, against which the calculated 2 m 
profits can be evaluated. However, this p 
not mean that the utility function would ch 
linear throughout the entire possible size dria 
of loans. A small operator would be en 
to lend $10,000 or more to any one (n 
vidual, regardless of credit score. Ek не 
shape and extent of the utility curve must : 
taken into account for each lending. situatio : 

The greatest problem in determining ar 
credit scoring cutoffs is likely to be cause d 
the preselection exercised by рп 
credit evaluators. As pointed out earlier, 4 
applications which had previously Deen zi 
cepted are shown in Table 1 and have ad 
used for the models in this me Бау 
probabilities of those who were rejected M 
simply not known, although they are аш » 
to be low. Since this is the case, the mo Te 
presented here are, strictly speaking, Ral 
used only after the customary subjectiv' 


E s redit 
Screening process has been carried on by с 
evaluators, 
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RELEVANCE OF PERSONAL NEED SATISFACTION 
FOR OVERALL SATISFACTION AS A FUNCTION 
OF SELF-ESTEEM ' 


ABRAHAM K. KORMAN 
New York University 


The purpose of this research was to test the hypothesis that need satisfaction 
was related to overall satisfaction for high-self-esteem individuals, but not for 
low-self-esteem individuals. The hypothesis was supported in 2 correlational 


studies an 


d 1 experimental study. Implications of the research for theories of 


satisfaction and possible interpretation. in terms of childhood learning ex- 


periences were discussed. 


An often-proposed theoretical explanation 
as to why people choose a given behavioral 
role is that such choices are determined by 
the characteristics which a person sees in 
himself (i.e, his wants for that type of role) 
and which roles he believes will satisfy these 
personal wants and desires (cf. Vroom, 1964). 
To the extent, then, that the chosen role 
provides reinforcement for these personal 
wants and desires, this type of framework 
would predict increased liking for and satis- 
faction with that role. However, the possibility 
that people may choose roles because of their 
general acceptability and “social” character- 
istics, and like them on the same basis, in- 
dependently of one’s own desires, is not 
typically included in this framework, even 
though such phenomena occur and, sometimes, 
at cross-purposes with individual wants (Kor- 
man, 1967). 

Thus, there is research which suggests that 
the “personal” model may be somewhat of an 
oversimplification. Blumenfield (1965) hy- 
pothesized that for individuals who had 
recently reenlisted in the Navy there would 
be a high correlation between their own 
values and the values they expected to be 
Supported in the Navy. His correlations were, 
however, negative in direction (7 = — .18 
with N = 108, p< .10; 7= — 33 with N = 
157, p < 01). Similarly, Schletzer (1966) 
found no relationship between scores on 
Strong Vocational Interest Blank scales and 
—— 

1 This research was partially 
from the New York Universi 
Research Fund. Part of the d 
Paper was presented at à meeti 

Sychological Association, Boston, 


supported by а grant 
ty Arts and Sciences 
ata reported in this 
ng of the Eastern 
April 1967. 


satisfaction with one’s occupation for six 
separate occupational groups. 

In previous work (Korman, 1966, 1967) 
the writer has suggested and verified in several 
independent occupational choice situations the 
hypothesis that the “personal” model holds 
only for those high in self-esteem, which is 
defined as one’s general evaluation of himself 
as a need-satisfying adequate individual. This 
was derived from the theoretical assumptions 
that individuals will find satisfying those 
situations which maximize their sense of 
cognitive balance and will engage in be- 
havior appropriate to the attainment of 
those situations. One further theoretical as- 
sumption, not made explicit previously, is that 
there exists a social norm that individuals 
should find situations where their self-per- 
ceived needs are satisfied and where they per- 
form well as more satisfying than situations 
where this is not the case. 

The purpose of this paper is to report 
three further studies designed to extend this 
hypothesis to situations where the dependent 
variable in a situation is overall liking or 
satisfaction with it. Basically, it was hy- 
pothesized in all cases that for individuals of 
high self-esteem, situations where self-per- 
ceived needs are being satisfied are judged as 
being more satisfying than situations where 
one’s self-perceived needs are not being satis- 
fied. On the other hand, stemming from both 
theoretical assumptions above, it was hy- 
pothesized for low-self-esteem individuals that 
there is no relationship between satisfaction 
with a situation and the extent to which one’s 
self-perceived needs are being met in that 


situation. 
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Stupy ONE 


The first study consisted of testing the 
above hypothesis in a study of social groups 
on the campus of а large private Eastern uni- 
versity. It was predicted on the basis of the 
above reasoning that an individual's overall 
satisfaction with a student group could be 
predicted by a knowledge of the discrepancy 
between the kinds of personal desires a person 
wanted satisfied in his Broup activities and 
the kinds of reinforcements he actually re- 
ceives, but only for high-self-esteem individ- 


uals. Such predictive ability would, on the 
other hand, break down for low-self-esteem 
people. 
Method 


Sample. The sample consisted of 70 male and 57 


a large private Eastern 


in all. Since previous 
research by the author (Korman, 1967) has indicated 


that the theoretica] Approach seemed to be ap- 
i ; the groups were combined for 


Were as follows: 
(a) Self-Esteem—Seli-esteem was m 
the “Self-Assurance” scale of the Ghi 
Self-Description Inventory, Thi 
to measure the extent to which 
self as an adequate, competent, need-satisfying in- 
has been used by the author in his 

previous investigations, Evidence for the construct 


(c) Group 
Which each 
group, that is, 
With, were measured by a ques 


(d) Group Satisfaction —Each individual’ 


E S overall 
satisfaction with his favorite socia] group, that is, 
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the one he spent most of his time with, was quen qe 
by a 5-point Likert scale administered Ed 
a Personal Characteristics Blank which also in iS 
Whether a person belonged to a вопр at i. 
five steps of this scale, in descending order, йу 
labeled as follows: (1) I find it qoe ings ey 
ing and interesting; (2) In general, I find i of the 
worthwhile; (3) It’s at least as good as most p 1 
Other groups I could spend my time a d the 
would probably join a different group if I ha ах 
time to look around; (5) I don't know why I us 2n 
my time with them. These responses were nue tion. 
a S-point basis from “most” to “least” satisfac d- 
Procedure. (a) The questionnaires ba tei 
ministered during regular class meetings of 2. ihe 
ductory Psychology classes? In almost all case. са 
“Ideal Group” and “My Favorite Group ques ae 
naires were administered in separate meetings Ау es 
ing about 2 wk. apart. The other questionn 
Were randomized as to presentation. , “high” 
(b) Individuals were then grouped into dan 
and “low” self-esteem categories, using the ena 
for the national norms as the point of Eme 
Within each “Self-Esteem” category, the ree in 
were then grouped into “high” and “low” satisfa the 
categories on the basis of their responses tod 
S-point Likert scale, The “high” group was em 
to be those checking the highest scale category, dnd 
the “low” group was considered to be those ШЕ е 
Satisfaction Categories 1—4. Thus, the four sepa Ns 
Cells which were developed and their dep Sox 
were High Self-Esteem, High-Satisfaction (AN - Поз 
High Self-Esteem, Low-Satisfaction (N = 15), Low 
Self-Esteem, High-Satisfaction (N = 47), and the 
Self-Esteem, Low-Satisfaction (N = 42). While е 
High-Satisfaction BTOUDS were automatically ae 
across self-esteem by the grouping procedure us h- 
two cases had to be eliminated from the BE 
Self-Esteem, Low-Satisfaction group in order the 
equate the two Low-Satisfaction groups ОП ing 
satisfaction variable, A. a result of таан 
these two Cases, the mean satisfaction score ee 46 
High-Self-Esteem, Low-Satisfaction group esee 
While the comparable mean for the Low-Self-Es 
Low-Satisfaction People was 3.43, then 
(c) Average item-discrepancy scores Were née 
computed between “desired” and “obtained” hest- 
Satisfaction for each $ utilizing the three tag cun 
rated needs for each (four in the case polio 
These were computed by subtracting the obtz 
Satisfaction from the desired. 
M T IE irk- 
?'The author's appreciation goes to James ER 
Patrick and Donald Davis of New York ie 5s. 
for allowing the use of their classes in DA was 
®In previous Studies, the point of d ied 
1/3-2/3, approximately. Since this apponi a o 
median on the national norms, it was s later 
adopt the more specific cutting point in uh 
Studies, Although for some unexplained ds below 
average level of this group was Suse “highs” 
the national median, sufficient numbers o 
and “lows” did appear for analysis. 


$e 


NEED SATISFACTION AND SELF-ESTEEM 


Results 


The results of the investigation are sum- 
marized in Table 1 and indicate that both 
hypotheses were strongly supported. The 
average discrepancy between “desired” and 
‘obtained” satisfaction shows a strong nega- 
tive relationship to overall satisfaction, but 
only for the High-Self-Esteem group. On the 
other hand, there is almost no difference at all 
In average item-discrepancy scores for the 
Low-Self-Esteem groups, despite the fact that 
they claim differences in satisfaction with their 
Broups. In fact, the two means are actually 
in reverse order from what would be predicted, 
although far from significantly so. 


Stupy Two 


The purpose of this study was to replicate 
the previous findings in the different, un- 
related context of job satisfaction, a context 
which is perhaps of somewhat greater sig- 
nificance to the individual than that of satis- 
faction with a social group and where much 
previous theorizing has concentrated on the 
need-satisfaction model detailed in the intro- 
duction to this paper (cf. Dawis, England, & 
Lofquist, 1964; Schaffer, 1953). The pre- 
diction was similar to that in the previous 
study in that it was hypothesized that overall 
job satisfaction could be predicted on the 
basis of need-satisfaction discrepancies for 
high-self-esteem people, but not for those with 
low self-esteem. 


Method 


Sample. The sample consisted of 52 night-school 
Students at a private Eastern university in a large 
City, all of whom were employed full time during the 
day and had been on the same job at least 6 mo. 

Í this sample, 29 were men but, as in the previous 
Study, the combined group was used in the analysis. 

Instruments. (a) Self-esteem was measured in the 
Same manner as in the previous study, that is, by 
the Self-Assurance scale of the Ghiselli Self-Descrip- 
ton Inventory. 

(6) Individual job “desires” and what one per- 
ceived as being received from one's job were deter- 
mined by administering the Crites Vocation Survey 
twice, once under a “normal” self-description set 
: Once when they were asked to describe their 
Jobs, This is a Likert-type instrument which is 
derived from factor-analytic research in this area 
and Which has the following need scales: Material 
“curity, Job Freedom, Structure, System, Personal 

atus, Behavior Control, and Social Service (Crites, 
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TABLE 1 


SUMMARY OF RESULTS: AVERAGE ITEM DISCREPANCIES 
BETWEEN "DESIRED" AND "OBTAINED" CHARAC- 
TERISTICS FOR THOSE DIFFERING IN GENERAL 
SATISFACTION WITH THEIR SOCIAL Group 
AS A FUNCTION ОЕ SELF- 


EsTEEM 
General High Low 
satisfaction self-esteem self-esteem 
High 
М 469 .679 
SD .289 485 
N 23 47 
Low 
M .898 .642 
SD 723. 577 
N 15 42 
P 2.52* 32 
df 36 87 
Тыз —.54 04 
+2 «.01, 


1961). The administration of the instruments took 
place 2 wk. apart.4 

(c) "Overall" job satisfaction was measured by a 
specially developed scale of job satisfaction designed 
to measure the individual's overall "affect" toward 
his job. The scale consisted of five Likert-type 
items aimed at measuring the individual's general 
feeling toward his job. Since preliminary analysis 
indicated that these items showed the expected high 
intercorrelations the responses were summed for 
analysis purposes, thus providing a range of scores 
on “general job satisfaction” from 0 to 25. 

Procedure. (a) The questionnaires were adminis- 
tered in two separate sessions 2 wk. apart. At the 
first administration the Ss were asked to take home 
and fill out the Ghiselli Self-Description Inventory, 
the Crites Vocation Reaction Survey (self-set), and 
the Job Satisfaction Questionnaire. When they re- 
turned these 2 wk. later they were then asked to 
complete the Crites questionnaire under а job- 
description set. All Ss were completing a research- 
participation course requirement. 

(b) "High" and "low'" self-esteem groups were 
derived as previously based on responses to the Self- 
Assurance scale on the Ghiselli Self-Description 
Inventory. 

(c) “High” and “low” job-satisfaction groups were 
then derived on the basis of the generalized measure 
of job satisfaction within each self-esteem group 
separately, as in Study One. The four cells which 
were developed are shown in Table 2. 


*'The author's appreciation goes to Lawrence 
Karlin of the Department of Psychology at New 
York University for his assistance in this administra- 


tion. 
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ТАВГЕ 2 


MEAN SATISFACTION SCORES rog HIGH- AND 
Low-Satisraction Groups 


Mean job | , 

Group satisfaction] 7 
High Self-Esteem, High Satisfaction 21.00 13 
Low Self-Esteem, High Satisfaction 20.50 9 
High Self-Esteem, Low Satisfaction 17.16 17 
Low Self-Esteem, Low Satisfaction 17.00 13 


(d) Average need-discrepancy scores were then 
computed between “desired” and “obtained” need 
satisfaction for the two most important needs (three 
in the case of ties) in the same way as previously. 


Results 


STUDY THREE 
While the results of 


“social group” 
been described by the $ himself, thus leading 

ambiguities of interpretation, For 
individuals will 
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versities and the kinds of characteristics which 
they would emphasize to their students, while 
Study B consisted of a set of verbal descrip- 
tions of different kinds of college groups. 
The kinds of behaviors chosen for these de- 
scriptions generally conformed to several of 
the "needs? proposed by Murray (1938) and 
utilized in the Edwards Personal Preference 
Schedule (EPPS; Edwards, 1954). It 19 
predicted that the high-self-esteem individua 
would be more likely to rate one "environ 
ment" over another as а function of his rela- 
tive need-strengths, Hence, there should be 4 
Positive correlation between relative need- 
strengths and comparative ratings of “environ- 
ments” for the High-Self-Esteem group. How- 
ever, such a correlation should not exist for 
the low-self-esteem individuals. 


Method 


Sample. The Ss for Study A consisted of 45 um 
graduate and 15 extension students, 37 of whi 
Were male. The sample for Study B consisted © a5 
undergraduates, of which 43 were male. There ке 
ап overlap of 9 students between the two samP js 

Instruments, (a) Self-esteem was, as dn] 
measured by the Self-Assurance scale of the Ghis¢ 
Self-Description Inventory (SDI). 

As a measure of self-perceived needs, ш” 
Was utilized. This is a forced-choice inst a 
Which is ipsatively Scored, thus providing i 
measure of the relative Strength of various "e° 

within the individual, ities 

(c) Questionnaires describing different universi 
(or college groups) were developed as a measure 


TABLE 3 
SUMMARY оғ Rxsurrs: AVERAGE Irem DISCREPAN 
BETWEEN “DESIRED” AND “OBTAINED” Јов Cuat- 
ACTERISTICS FOR THOSE DIFFERING IN JOB 
SATISFACTION AS A FUNCTION OF 
SELF-ESTEEM 


cies 


— oi 
ада = p n 
Job satisfaction | High self-esteem | Low self-estee' 
High 
M 2.10 4.09 
SD 2.55 2.62 
N 13 9 
Low 40 
M 3.92 t 
5р 2.00 2:04 
N 17 13 
t 2.04* d 
d Ў 19 
if 28 = 


*p <.05. 
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TABLE 4 
STUDY A: CORRELATIONS BETWEEN AFFILIATION-ORDER 
NEED Discrepancy AND COMPARATIVE RATINGS 
OF "AFFILIATION-ORIENTED" AND "ORDER- 
ORIENTED” UNIVERSITIES 


High self-esteem | Low self-esteem 


N 19 4 
r ,65* —.12 


P00, 


different “environments.” The descriptions for uni- 
Versities involved such as “emphasizes hard work 
and accomplishment," "emphasizes innovation and 
Change," “realizes the importance of social relations,” 
etc. The descriptions for college groups were such as 
“leading other groups,” “making friends,” “intellectual 
activity,” etc. In each case Ss were asked to indicate 
degree of liking for each situation on a 5-point scale. 

Procedure. (a) The Ss were administered the 
EPPS and the Ghiselli SDI at one class session. 
Several weeks later they were administered the 
“environmental description” blanks. In the first case, 
Ss were told the data collection was part of a 
departmental project while in the second case they 
were told it was for university purposes. 

(b) After deriving high and low self-esteem as 
previously, separate correlations were computed 
between level of need discrepancy on the EPPS for 
two needs and tendency to rate the corresponding 
environment over the other. For Study A the two 
needs studied were need for affiliation and need for 
order while for Study B the two needs were change 
and affiliation, with these variables chosen because 
of their relevance to the contemporary college 
environment. The verbal descriptions utilized were 
deliberately constructed in order that different “need 
Pairs” could be utilized in the two studies. 


Results 

The results of the two studies are sum- 
marized in Tables 4 and 5 and in all cases 
indicate strong support for the hypothesis. 
That is, the correlations are significant in 
both cases for the High-Self-Esteem group 
but in neither case for the Low-Self-Esteem. 
While the results of Study A are somewhat 
More impressive than of Study B, both studies 
are supportive of the hypothesis. 


DISCUSSION 


The results of this investigation indicate 
that the notion that satisfaction is “personally 
determined” in that situations are evaluated 
according to the extent to which they are 
Satisfying one's desires may be somewhat 
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oversimplified. That is, it seems apparent 
that the meaningfulness of the “satisfied” re- 
sponse in terms of its correlates and possible 
determinants does not seem to be the same 
for groups differing in self-esteem. 

Several questions stem from this finding, it 
would appear. For example, what determines 
the "satisfied" response for the low-self-esteem 
person if self-perceived need satisfaction does 
not? One possible hypothesis stems from our 
suggestion that the low-self-esteem person may 
be more subject to the influence of others in 
choosing a vocational role, even though the 
choice is not perceived as “self-fulfilling,” 
since “self-fulfilling” or need-satisfying states 
are not in *balance" for him. A similar process 
may operate in the "satisfaction" situation of 
concern here in that the low-self-esteem per- 
son may evaluate a situation in terms of how 
he perceives others rate it and what its gen- 
eral social “acceptability” is, rather than in 
terms of how the situation meets his needs. 
Thus, for example, a person of low self-esteem 
may see a situation as not meeting his needs 
at all and yet might say he was very satisfied 
with it, if he thought that other people in the 
situation were “happy” with it. On the other 
hand, he might rate it unsatisfactorily if he 
thought other people were unhappy with it, 
independently of how he himself felt about it. 
In this sense, then, one might argue that the 
low-self-esteem person is “externally oriented” 
in that he generally desires to go along with 
others independently of what he might want 
in a specific situation and across different 
situations, while the high-self-esteem individ- 
ual is under “internal orientation” in that 
the world is evaluated according to his own 
desires and his own self-perceived needs in a 


specific situation. 


TABLE 5 


Srupy B: CORRELATIONS BETWEEN CHANGE-AFFILIA- 
TION NEED DISCREPANCY AND COMPARATIVE 
RATINGS or *CHANGE-ORIENTED" AND 
“ AFFILIATION-ORIENTED" 
COLLEGE GROUPS 


High self-esteem | Low self-esteem 


29 42 
.39* .24 


ы. 


жр < .05. 
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A second question of considerable theo- 
retical interest, but also of importance in а 
practical sense, is why should "consistency 
be so important, since it seems to fly so much 
in the face of “common sense"? One possible 
interpretation may be suggested in the area 
of childhood training. This is that the in- 
dividual is encouraged to be consistent and 
noncontradictory in his behavior by both 
social norms and parental strictures. He thus 
seeks out and prefers situations which reduce 
the anxiety which would develop as a result 
of violating such norms not to be “contradic- 
tory,” even though such situations may ac- 
tually be nonbeneficial to himself. This kind 
of behavior would also be predicted to be 
more likely the more one were to be suscep- 
tible to these norms, a characteristic com- 
monly associated with low-self-esteem individ- 
uals. 

One final point which can be made here 
may serve to support further the point of 
view advanced. An examination of Table 
3 indicates that there was generally a greater 
discrepancy over both "low" and “high” 
satisfaction conditions for the Low-Self- 
Esteem group, although the groups had been 
equated for “satisfaction” and all had been 
hus, if we ignore 
ratings, then we 


ast 6 mo. is more 
“personal need satisfac- 
esteem than for low-self- 


esteem individuals. While this is а concurrent- 


ABRAHAM K. KORMAN 


validity post hoc type of relationship € 
needs further investigation, it is оу 
consistent with the general proposals ad- 
vanced. 
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VOCATIONAL INTERESTS OF COMMUNITY 
RECREATION ADMINISTRATORS 
USING THE SVIB 


KEITH B. ROYS, Sn. 


University of Missouri Department of Recreation and Park Administration 


A Community Recreation Administrator scale for the SVIB for Men was de- 
veloped by testing 433 members of this occupation. The interests of community 
recreation administrators were most like those of public administrators, YMCA 
secretaries, and. Chamber of Commerce executives and least like physicists, 


mathematicians, chemists, and engineers. 


The SVIB for Men is widely used and dif- 
ferentiates between more than 50 occupations 
and therefore was selected to determine 
whether male community recreation admin- 
istrators could be distinguished from men in 
other occupations. The resulting scale should 
aid vocational guidance counselors in helping 
young people who are considering, or should 
consider, a career in community recreation. 

Many Recreation majors in universities 
have not been admitted to a Recreation cur- 
riculum until their second or third year of 
college because they did not know that such 
a program existed. If counselors in high 
schools and colleges knew of this course of 
study, advisees interested in community rec- 
teation could be apprised of the field early 
in their academic career. 

With the increase in employee recreation 
programs, this new scoring key could be an 
asset to personnel directors in business and 
industry in the selection of new employees or 
relocation of employees when a move is in- 
dicated. 


METHOD 


ers of state recrea- 


Directories and membership rost 
i the United States 


tion societies and associations in 
Were used in compiling a list of 1,000 names and 
addresses of potentially qualified people. A letter 
Was sent to each, along with a self-addressed return 
Postcard requesting information on sex, current oc- 
Cupation, age, education, and experience. Six hundred 
Wenty-five postcards were returned; 560 were ap- 
Parently qualified. The 1964 research edition of the 
5 was sent to these 560; 492 or 88% were re- 
turned, after only one follow-up letter. Four hundred 

irty-three were found to be actually qualified. 

A randomly selected criterion group of 350 was 
Compared with the SVIB Men-in-General (M-I-G) 
Etoup, Each item on which the two groups’ responses 


differed by 17% or more was keyed a plus or minus 
one depending on the direction of the difference. The 
remainder of the qualified responses (83) were used 
as a cross-validation group. 

The criterion group was scored with this key. 
The mean and standard deviation of the raw scores 
were used to establish standard scores using the 
traditional formula. 

м =) 10 4- 50, 
с 


Standard Score = 
where: M = Raw score, X = Mean of criterion group, 
= Standard deviation of criterion group. 


Letter designations were assigned to standard scores 
in the same manner usual for SVIB scoring keys; 
that is, 45 and over = A, 40-44 = B+, 35-39 = B, 
30-34 — B—, below 30 — C. 

Test-retest reliabilities of the new key are reported 
in Table 1 for five groups with intertest intervals 
ranging from 2 wk. to 30 yr. Scores on the key ap- 
pear to be highly stable (r=.9) over periods of 24 
wk.; moderately stable (r = .6-.7) over periods of 
one to two decades. . 

Validity was established by using the following 
method. Using Tilton's (1967) table, the percentage 


TABLE 1 


RELIABILITY or THE COMMUNITY RECREATION Ар- 
MINISTRATOR SCALE UsixG TrsT-RETEST 
CORRELATIONS 


Time between 


Group 
test and retest| ^ э 


University of Minnesota sopho- 
mores (7 = 139) 


2 wk. 93 


30 days .92 | Army personnel (n = 102) 
8 yr .62 | Minnesota high school seniors, 
й later University of Minnesota 
graduates (и = 171) 
22 yr. 72 | Stanford University seniors 1929 
(п = 191) 
30 yr. .50 | Bankers in State of Minnesota 
(n = 93) 
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TABLE 2 


STANDARD Score MEANS, STANDARD DEVIATIONS, AND 
PERCENTAGE OF OVERLAPS OF THE VALIDATION, 
Cross-VALIDATION, AND MEN-IN-GENERAL GROUPS 
SCORED ON THE COMMUNITY RECREATION 
ADMINISTRATOR SCALE 


Group 
o us RN 
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of overlap in the sccres of the criterion and ipn 
groups was computed and compared with the De 
centage of overlap of the cross-validation = 
M-I-G groups. The criterion group had an 1 i 
overlap with M-I-G; the cross-validation ФНР 
20% overlap—a shrinkage of only 2%% (see Table 2). 


RESULTS 


& " У in- 
Scoring the community recreation adm 


Cri- MG, Cross: istrator criterion group members on e 
fenem |7 Validation available occupational scales, it was fo А 
P that the occupational group with the greates 
sD ee 100 134 Er similarity of interests to men in wes 
Percentage of overlapping| 18% 20%, was that of public administrator (see pe 
3 and Figure 1). However, in scoring 
TABLE 3 


Hicnest AND Lowest SVIB Scare MEANS FOR THE CoMMUNITY 
CRITERION Grovp 


RECREATION ADMINISTRATOR 


High Low 

ard 

Standard Standar 
Scale RE Scale score 
1. Public Administrator 46.89 1. Physicists 6.83 
2. YMCA Secretary 44.38 2. Mathematician 10.65 
3. Chamber of Commerce 43.92 3. Chemist 11.90 
4. Social Science Teacher 41.85 4. Engineer 13.29 
5. Physical "Therapist 41.72 5. Carpenter 13.73 
6. Social Worker 41.01 6. Architect 1547 
7. Rehabilitation Counselor 40.85 7. Dentist 16.74 
8. Credit Manager 39.47 8. Senior CPA 18.69 
9. Business Education Teacher 38.27 9. Artist 19.46 
10. Personnel Manager 35.68 10. Biologist 20.45 

TABLE 4 
Occupation Groups Тндт Scorep HIGHEST AND LOWEST ON COMMUNITY 
RECREATION ADMINISTRATOR SCALE 
High Low 

d 

Group Standard Standar 
score Group scor 

1. YMCA Secretary 45 бї 450 
2. Chamber of Commerce F4 2 es и j 6.38 
3. Social Worker 34.49 3. Chi D ED 9.28 
4. YMCA Physical Director 34.03 4. Engines oF 
5. Business Education Teacher 33.86 5. ‘Agha 10.90 
б. Rehabilitation Counselor 33.26 6 AL 11.46 
7, Credit Manager 3227 7. i 13.94 
8. Social Science Teacher 32.21 8. Experimental Psychologist 1416 
9. Physical Therapist 32.07 OF Atho list 14. 

10. Air Force Pilot 30.19 10. thea > 15.90 


— 
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PROFILE — STRONG VOCATIONAL INTEREST BLANK FOR MEN 


FOR USE WITH SVIB FORM 1399 OR T399R, HAN! 


D-SCORED ANSWER SHEET, AND HAND-SCORING STENCILS 


LETTER RATINGS AND STANDARD SCORES 


Plus Minus Row S. 
Gro 
в Scale sore Score Score Score c 


Cr в- B 8+ A 


Dentist 


OSTEOPATH 
VETERINARIAN 


itd з5ү119) _знун бул 


PHYSICIAN 


PSYCHIATRIST 
PSYCHOLOGIST 


Biotosist 


ARCHITECT 


угун 15813. 


MATHEMATICIAN 


Prysicist 
CHEMIST 


ENGINEER 


ProbucrioN MGR. 
Army OFFICER 


Air Force OFFICER 


awyn 31001. 


CARPENTER 


Forest Service MAN 
FARMER 


3ov 


MATH-SCIENCE TEACHER 


PRINTER 
POLICEMAN 
PERSONNEL DIRECTOR 


xas 


M 


Ривис ADMINISTRATOR 


REHABILITATION COUNSELOR 


‘YMCA SECRETARY 
Soci, WORKER 


31v0 $ AvaoL 


SOCIAL SCIENCE TEACHER 


‘ScHOOL SUPERINTENDENT 
MINISTER 


LIBRARIAN 
Азтт 


MUSICIAN PERFORMER 


Music TEACHER 
CPA Owner 
Senior CPA 


ACCOUNTANT 


Orrice WORKER 
PURCHASING AGENT 


BANKER 
PHARMACIST 
MORTICIAN. 
SALES MANAGER 


IX 


3310Y4W3 20 1COHDS 


REAL ESTATE SALESMAN. 
Lire INSURANCE SALESMAN 
x Aovertisinc MAN 


Lawyer 


INO1Y201 ONY 3wyN} 


AUTHOR-JOURNALIST 
XV Pres., Мес. CONCERN 


Suppl. Occup. Scales 


Crenit MANAGER 


Снлмвев or COMM. EXEC. 


PHYSICAL THERAPIST 
COMPUTER PROGRAMMER 


Business Epuc. TEACHER 


Community Rece. ADMIN. 


С) ^e 


Nonoccupational 
Scales | S: — ар nei 


Stonford University Press. 
Fic, 1. How the © 
Tepresentatives of the other occupational ref- 


Srence groups on the new community recrea- 
tion administrator's scale, the converse was 


Tow stondord 


ommunity Recreation Admini: 
occupation scales. 


MF: 


ЖООЛУ row standard 


Stanford, Colifornio 


strator criterion group scored on other 


not true (see Table 4 and Figure 2). Com- 
munity recreation administrators had interests 
in common with many public administrators; 
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PROFILE — STRONG VOCATIONAL INTEREST BLANK FOR MEN 


FOR USE WITH SVIB FORM 137? OR T3952, HAND-SCORED ANSWER SHEET, AND HAND SCORING STENCILS 


Plus Minus 
Score 


Group Scale 


i Dentist 


Score 


LETTER RATINGS AND STANDARD SC 


[3 c s 


в 


Bt 


ОзтеоРАТН 


VETERINARIAN. 


PHYSICIAN 


i 
E 


PSYCHIATRIST. 


PsvcHotocisr. 


Biciocisr 


П Architect 


MATHEMATICIAN 


Pursicist 


Chemist 


ENGINEER 
m Proouction Mos. 


змеем isau 


Army Orricer 


Ait Force Orricer 
iv [gm 


Forest Service MAN 


avom 302v 


FARMER 


МАТН-5СІЕМСЕ TEACHER 


Printer 


POLICEMAN 
У PERSONNEL Director 


Pustic ADMINISTRATOR 


REHABILITATION COUNSELOR i| 


YMCA Secretary 


Sociat Worker 
Sociat Science TEACHER 


SCHOOL SUPERINTENDENT 


зом 


а адо ЛЕГ ЖИЙ 


хаз 


s meee Here 
-r 
nnne nd 


Minister 
vi Liararian 


a 4] 


аннынан 


анн] 
DUE Ce 
peni nt 


зіма s AvaOL 


Автт 


h n * + 


Musician Perrormer 


Music Teacher 


уп CPA Owner] — | 


vi Senior CPA 


ACCOUNTANT 


Orrice Worker 


PURCHASING AGENT 


Banker 


PHARMACIST 


Mortician 
1x Saves MANAGER 


Reat Estate Satesman 


Lire Insurance SALESMAN. 
x ADVERTISING Man 


Lawyer 


AutHor—Journaust 
XI Prts. Mro. Concern 
Suppl. Occup. Scales 


Скот Manacer 


CHAMBER or Comm. Exec, 
PHYSICAL Therapist 


EC s Жы; 
рер 


= а 
MAREC aaar aan С) 


ззхоланз 30 10005 


Молмол QN эуез 


Computer PRoceammer 
COMPUTER PROGRA 


Business Eouc. Teacner 
Community Весе ADMIN, 
Nonoccupational 


Scales 


most public administrators, however, did not 
have the same interests as community гесгеа- 
tion administrators. The public administrator 
key had been derived from a criterion group 


tow wandard 


that 


and various others, 


AACH: 
+ 


Lea 
—— "uw. ла | NUMBER 


А . ad- 
included city managers, hospital 
ministrators, public recreation adminis 


trato? 


А гей” 
Table 3 also shows that community 166 
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TABLE 5 


"Банан BETWEEN COMMUNITY RECREATION 
ADMINISTRATOR SCALE AND OTHER OCCUPATIONAL 
SCALES ON THE SVIB 


Highest Lowest 
Scale r Scale r 
2. YMCA Secretary .93| 1. Physicist 
55 Chamber of Commerce .82| 2. Architect 
3. Social Worker 75| 3. Engi 
+ Rehabilitation Counselor 444] 4. 
a Credit Manager лі 5. Chemist 
i Busin s Education Teacher|.71| 6. Dentist 
+ Soci: ence Teacher .68| 7. 2 
8. Public Administrator .64 | 8. 
9. Personnel Director -61| 9. 
10. Superintendent 160 |10. Farmer 


tion administrators scored high on the YMCA 
Secretary and the Chamber of Commerce Ex- 
ecutive scales. It was interesting to note that 
the men who were employed in these fields also 
scored high on the new community recreation 
administrator's scoring key. Correlation of 
the scores of the community recreation ad- 
ministrator with the last two vocational 
groups was also high—.93 and .82, respec- 
tively (see Table 5). 


TABLE 6 
POPULAR IwTERESTS INDICATED BY THE COMMUNITY 
RECREATION ADMINISTRATOR CRITERION GROUP 


Item number | % Item 
1. 224 (L)* | 98.6 | Conscientious people 
2. 242 (L) |98.0 | People who are natural leaders 
3. 207 (L) |97.4 | Taking responsibility 
4. 396 (1)» | 96.9 | Very much interested in my work 
5. 236 (L) | 96.0 | Energetic people 
6. 372 95.4 | Derive the greatest pleasure and 
(Yes)* reward from doing a high- 
quality job 
7. 344 (1) | 94.0 | Great variety of work versus 
similarity in work 
8. 127 (L) | 93.4 Physical education Г 
9. 222 (1)* | 91.7 Competitive activities 
10. 206 (L) | 90.9 Meeting and directing people 
11. 243 (1) | 90.6 | People who assume leadership 


rentheses refers to which column on the 
hecked. For example, where an L is 
‘liked’ the item as opposed to "in- 
the item. The "Yes" refers to the fact 
Jumn which said they would derive 
“would not derive pleasure. 
rk made by the re- 


Note.—Material in pai 
SVIB the respondent c 
marked, the respondent 
difference" or "disliked 

hat 95.4% marked the со 


Dleagy ed to 
ure . opposed 
ee ber 1 caters to the check mai 


-." Number 1 refers to the 
SDondent in Column 1 of the SVIB. 
* 1964 edition of the SVIB only. 
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TABLE 7 


DirFERENTIAL INTEREST ITEMS ON THE COMMUNITY 
RECREATION ADMINISTRATOR ScORING KEY 


Item number | Differential Item 


1. 70 (L) 544 Playground directo 

2. 7(L) 53.1 Athletic director Е 

3:243 (1) 10.6 People who assume leadership 
4. 202 (L) 36.9 Teaching children 

5. 225 (L) 36.4 Continually changing activities 
6. 199 (L) 33.7 Making speeches 

7. 131 (L) 33.1 Public speaking 

8. 331 (3) 33.1 Deal with people 

9. 158 (L) 32.9 Conventions 
10. 196 (L) 31.7 Interviewing men for a job 


Note.—See Note of Table 6. 


A lack of mutual interests between com- 
munity recreation administrators and physi- 
cists, mathematicians, chemists, and engineers 
was demonstrated by the low standard scores 
seen in Tables 3 and 4 and by the negative 
correlations seen in Table 5. 

The popular responses of the community 
recreation administrator criterion group mem- 
bers are listed in Table 6. These items fell 
into three categories: the first was related to 
the personality of the individual—they liked 
conscientious people who were natural leaders 
displaying energy and assuming leadership. 
A second category reflected something of 
their personal activity interests—a desire for 
competitive activities and physical education. 
The third category related to their work—it 
indicated that they were interested in and 
enjoyed their work, and received a great deal 
of pleasure and reward from doing a large 


variety of things well. 
Differential interests (see Table 7) showed 


the man in recreation enjoyed working 
actively with people, for example, playground 
directors, athletic directors, and teachers of 
children. He was also concerned with factors 
other than face-to-face leadership in active 
settings, as indicated by the high percentages 
on the items which related to administrative 
responsibilities such as interviewing men for 


jobs. 
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PREDICTIVE VALIDITY OF A BIOGRAPHICAL 
INVENTORY IN HIGHER EDUCATION 


RICHARD S. MACKENZIE 


University of Pittsburgh, School of Dentistry 


Scores on the Extracurricular Achievement Record, developed by Holland 
and Nichols, predicted professional extracurricular activities of 102 dental 


students. These activities involved leadership, simul 
and research. 3 hypotheses were tested: 


In 1964, Holland and Nichols developed a 
college-level biographical inventory of extra- 
curricular accomplishment called the Extra- 
curricular Achievement Record. Included in 
this inventory were subscales for measuring 
achievement in science, dramatic arts, litera- 
ture, music, art, and leadership. The following 
are examples taken from the Science subscale, 


Check those achievements that apply to you. 


Built a piece of equipment or laboratory 
apparatus on my own, 


(not as part of a course) Describe briefly. 
Appointed a teaching assistant in a scientific 
field. 


Received a research grant. Indicate nature. 


The entire list of statements included in both 
the Scientific subscale and the other subscales 
can be found in Holland and Nichols (1964), 

Among the Personality measures, biograph- 
ical inventories are considered to be the most 
reliable predictors of future performance 
(Nunnally, 1959). The biographical inventory 

as been used Successfully to predict pilot 
performance (Guilford, 1947) and salesman 
success (Ferguson, 1952; Sorenson, 1965), 
Because of this evidence, it was reasoned 
that the Extracurricular Achievement Record 
as an inventory of preprof : 


V $: essional collegiate 
extracurricular activities, might be valuable 
as an aid in selecting 


those students for 
dental school who would take an active in- 


terest in professional activities. The intent of 
this study was to determine whether the Ex- 


ated professional meetings, 
(1) students secking candidacy for 
higher scores than noncandidates on 
ar Achievement Record (р < .05); 
tudent American Dental Association 


а їп 
tracurricular Achievement Record does, 


{опа 
fact, have predictive validity for profession 
activities in dental school. 


METHOD 


reat 
Subjects. The Ss were members of the beta 
class at the University of Pittsburgh acon о 
Dentistry, In the fall of 1965, this class consiste 
104 students from 51 undergraduate colleges. nieve 
Predictive measure, The Extracurricular Ach! 
ment Record of Holland and Nichols was ad- 
Predictive measure used in this study. It S ee! 
ministered to 102 students during Orientation cale 
in September 1965, The score on the Total : 
and each subscale was determined by adding 
number of items checked. ures 
Criterion measures. The three criterion mere ive 
of professional activities used to test the PE 
validity of the Extracurricular Achievement ке 
Were: (1) student candidacy in class elections the 
student participation in giving table clinics “рау 
Student American Dental Association (ADA) 10% 
(3) student application for summer research fel 
ships, sures 
Procedures. Each of the three criterion mea an 
divided the students into two groups, parle? the 
and nonparticipants, The scores made earlier ement 
two groups on the Extracurricular Achiev three 
Record were compared to test the following ғу 
hypotheses: (1) students seeking candidacy ave 
Class office in the first-year class election ershiP 
higher scores than noncandidates on the mom i 
Scale of the Extracurricular Achievement tudent 
(2) students giving table clinics at the icipant? 
A Day have higher scores than nonpart! jeve” 
on the Total scale of the Extracurricular / тег 


= m 
ment Record; (3) students applying for by non^ 
research fellowships have higher scores t Extra 
applicants on the Scientific scale of the 


curricular Achievement Record. 
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Nue I. Two weeks after the semester began, 
e first-year class decided that candidates for class 
office must each give a 2-min. speech indicating his 
reasons for desiring candidacy. The aspiring student 
leaders were given 1 wk. to make their decisions, 
prepare their speeches, and gather electoral support. 
Of the 102 possible candidates, the names of 18 
Students appeared on the mimeographed ballot as 
candidates for office. It was reasoned that students 
who had high scores on the Leadership scale would 
be more likely to seek elective office than those 
who did not have high scores. 

Hypothesis П. On March 16, 1966, the local Stu- 
dent ADA held their fifteenth annual meeting. This 
meeting is modeled after State and National Dental 
Meetings and provides an opportunity for the stu- 
dents to develop the habit of participating in organ- 
ized professional activities. The table clinics put on 
exclusively by students provide experience in 
demonstrating new techniques, discussing dental 
problems, or presenting а research project. The table 
clinics are given in separate booths and consist of 
a formal presentation followed by questions and 
answers. Participation is entirely voluntary, just 
as it is in the professional organization. Table 
clinics are presented by 19 first-year students out 
of 96 (6 were lost at midyear). It was reasoned 
that students who had high scores on the Total 
scale for extracurricular achievement would be 
more likely to participate in professional-type ac- 
tivities than those who did not have high scores. 

Hypothesis 111. Each summer various institutions 
such. as Veterans Administration Hospitals, the 
Public Health Service, and various colleges and 
universities offer opportunities for dental students 
to participate in research activities. There is com- 
petition for these positions and interested students 
must apply early. On April 12, 1966, the first-year 
students were given a questionnaire asking what 
type of summer employment they were planning 
and whether they had applied for a research fel- 
lowship. If they had applied for a research fellow- 
ship, they were asked to describe the position. Re- 
search fellowships were applied for by 17 out of 
96 students. It was reasoned that those students 
who had high scores on the Scientific scale would 
be more likely to apply for summer research fellow- 
ships than those who did not have high scores. 


RESULTS 


Hypothesis I. Students seeking candidacy 
for class office in the first-year class election 
did score higher than noncandidates on the 
Leadership scale of the Extracurricular 
Achievement Record. The scores that the 18 
candidates for class office made on the Leader- 
Ship scale were compared to the scores of the 
remaining 86 students. The 18 candidates had 


Checked 53 out of a possible 216 leadership 


items, The 84 noncandidates had checked 181 
ship items. A 


Out of a possible 1,008 leader 


545 


TABLE 1 


Comparison OF SCORES ON THE LEADERSHIP SCALE 
FOR CANDIDATES AND NONCANDIDATES FOR 
Crass OFFICE 


Leadership items 


For class office Total 
ste Not 
Checked checked 
Candidate 53 163 216 
Noncandidate 181 827 1008 
Total 234 990 1224 


Note.—p < .05. x? = 5.26 with 1 df. 


chi-square analysis was done on the above 
2 X 2 table. 

The null hypothesis was that the distribu- 
tion of scores for the candidates and non- 
candidates should not differ from the marginal 
totals more than would be expected on the 
basis of chance. This null hypothesis was 
rejected at the p < .05 level. Thus, scoring 
high on the Leadership scale predicted par- 
ticipation in leadership activities. 

Hypothesis II. Students giving table clinics 
on Student ADA Day did score higher than 
nonparticipants on all scales of the Extra- 
curricular Achievement Record. The college 
extracurricular achievement scores of the 19 
students giving table clinics were compared 
to the scores of the 77 remaining students. 
The participating students had checked 145 
out of a possible 1,083 items. The nonpar- 
ticipating students had checked 404 out of a 
possible 4,389 items. A chi-square analysis 
was done on the following 2 х 2 table. 

The null hypothesis was that the distribu- 
tion of scores for the participants and non- 


TABLE 2 


CoMPARISON OF SCORES ON THE EXTRACURRICULAR 
ACHIEVEMENT RECORD FOR PARTICIPANTS AND 
NONPARTICIPANTS IN A STUDENT ADA Day 


Total items 


Student ADA Day "m "Total 
o 
Checked checked 
Participant 145 938 1083 
Nonparticipant 404 3985 4389 
Total 549 4923 5472 


Note.—p < 001. x? = 17.2 with 1 df. 


546 


ТАВГЕ 3 


COMPARISON OF SCORES ON THE SCIENTIFIC SCALE FOR 
APPLICANTS AND NONAPPLICANTS FOR 
SUMMER RESEARCH FELLOWSHIPS 


Scientific items 
For research 


Total 
fellowship Racked Not 
Check checked 
i 5 7 238 
Applicant 59 179 
Nonapplicant 142 950 1092 
Total 201 1129 1330 


Note.—p < .001. x? = 21.1 with 1 df, 


participants should not differ from the mar- 
ginal totals more than would be expected on 
the basis of chance. This null hypothesis was 
rejected at the p < .001 level. Thus, scoring 
high on the Extracurricular Achievement 
Record also predicted participation in extra- 
curricular professional activities, 

Hypothesis II. Students applying for sum- 
mer research fellowships did score higher 
than nonapplicants on the Scientific scale 
of the Extracurricular Achievement Record. 
The scores that the 17 applicants for summer 
research fellowships made on the Scientific 
scale of the inventory were compared to the 
scores of the remaining 78 students. The 17 
applicants had checked 59 out of a possible 
238 items of the Scientific scale. The 78 non- 
applicants had checked 142 out of 1,092 pos- 
sible scientific items, A chi-square analysis 
was done on the above 2 X 2 table. 
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Achievement Record of Holland and Nichols. 
Students who participated in leadership, sci- 
entific, or general extracurricular «саи 
as undergraduates continued to ee 
in similar activities while in dental school. 
Because behavioral patterns tend to Ls quo 
stable over time, it is reasonable to expect ien 
only that an active undergraduate will p^ 
ticipate in activities as a dental student, »- 
also that he will participate in various рг a 
fessional and community functions Werl 
аз a practicing dentist. Since most ae a 
are interested in members who have leaders : 
potential and scientific and cultural interes : 
it is assumed that educators in the profession: 
would be interested in utilizing biographic ; 
inventories such аз the Extracurricular 
Achievement Record in selecting candidate 
for their schools. ts 
From a training point of view, if sut 
could be guided by various ет 
Strategies in professional schools to develoP 
leadership skills, scientific inclinations, аг. 
the habit of participating in profession 
activities, then a measure similar to seht 
Extracurricular Achievement Record mig s 
be utilized to measure the results. For ке 
ample, if a group of students was effective Y 
trained in leadership skills and another gom 
of students was not, then the experimen ai 
group should score higher on a biographer 
inventory Concerning leadership activities 
lowing graduation, 
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A study in 3 sections of empirical data on managerial compensation for 3 groups 
of managers (N = about 90 for each group) : (1) a description of the distributional 
characteristics of pay over time (about 25 yr.); (2) the correlation of pay with pay 
over time and presents statistical analyses to explain the observed relationships; 
(3) a statistical model of pay capitalizing on the cumulative character of pay (pay 
at Year n is composed of pay at Year 1 + raises at Years 2,3, .-- mand the 
formulas for the distributional and correlational character oF composites. The 
potential psychological leverage of hitherto little-considered variables idm out— 
for instance, without increasing the total salary bill, management of the variance 
of pay over a group in a given year and of the correlation of pay with raises from 
year to year allows one to deal with the level of aspiration of the individual and his 
relative standing in the group. The managerial implications of the statistical 


behavior of pay are discussed in detail. 


1. DISTRIBUTION OF PAv OVER TIME 


| It is a truism to say that one knows very 
little about the psychological variables asso- 
ciated with pay. Even so, it needs to be said 
and repeated. On the one hand, on the side of 
Psychology, pay partakes of a variety of crucial 
theoretical issues. For example, although it is 
often sneered at as a motivator, even psychol- 
ogists, deep down, probably have an implicit 
faith in it. A variety of studies deal with it as 
а source of satisfaction (Herzberg, Mausner, & 
Snyderman, 1959; Lawler & Porter, 1963). 

heoretical frameworks include it under a 
Variety of guises (Vroom, 1964). As an imple- 
Ment of variable reinforcement schedules, pay 
Makes contact with a whole field of psychology. 
Yet, except for a group of pious generalizations, 


5 carried out with the help of a 
Company and the sup- 
e of Industrial Rela- 


1 ‘This research wa 

pant from the General Electric 
ine and facilities of the Institut 

со ns, University of California, Berkeley. Important 

es, Uributions were made by à variety of people, 

pecially M. E. Gordon, University of California, 
erkeley, 


© 1967 by the American Psycholo; 


1 


precious little is written about it. On the other 
hand, from the side of industry, there is also a 
variety of compelling reasons for attention. 
Pay is widely accepted as a prime motivator. 
Very large sums are discretionarily committed 
on the basis of assumptions about its action. 
Large amounts of so-called incentive pay are 
spent without any evidence about who becomes 
incensed, at what point, for how long, or under 
what circumstances. 

There is relatively little data on the behavior 
of pay. Companies and professional organiza- 
tions frequently collect cross-sectional data— 
so-called maturity curves—showing, for ex- 
ample, average earnings since the highest de- 
gree (Patton, 1961; Weissinger, 1958). For 
many psychological purposes, these have the 
usual drawbacks of cross-sectional data. It is 
impossible to say what happened to anyone 
over time in the data, and the measured money 
spent becomes the dependent variable rather 
than its impact on an individual. These data 


are useful to companies, since they provide 


gical Association, Inc. 
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guidelines for following either an implicit or 
explicit policy of paying a rate characteristic 
of the industry and the neighborhood. How- 
ever, this very kind of imitation in pay policy 
has inhibited a creative use of the motivational 
leverage presumably inherent In pay. To Sup- 
port and guide this kind of creative rethinking 
of the psychological characteristics of pay, 
various kinds of data are needed. This mono- 
graph will present three facets of compensation 
which seem particularly relevant to a psycho- 
logical analysis: characteristics of the dis- 
tribution of pay over a period of time, the 
correlations of pay with рау over time, and, 
finally, a statistical model of compensation. 
Included are three longitudinal studies of the 
pay histories of particular individuals. As far 
as is known, only one report on pay has been 
conducted on the basis of a longitudinal re- 
search design—a recent publication by Brenner 
and Lockwood (1965). 

As one turns to longitudinal data, several 
different parameters stand out, each with some 
possible psychological meaning. It may be 
something of an oversimplification to deal with 
them in the following manner, but it will get 
us into the problem. From the side of the com- 
pany, there is, first, the change in average pay 
over time. This is, of course, importantly, a 
variable cost to the company. In motivational 
terms, at any one time it represents the com- 
pany’s bid in the labor market and its evalua- 
tion of the services required. Over time, the 
change in the average pay represents a recogni- 
tion of the rate of development of the g 
of their usefulness to the com 
assumes perfect mobility, 
someone else, 

The standard deviation of Рау, on the other 
hand, would seem to reflect organizational 
variables; that is, the amount of difference in 
the Job assignments of the group largely deter- 
mines the spread of pay. This is complicated 
by the fact that individual differences will be 
recognized by variable raises. Since pay is im- 
portantly a cumulative affair, that is, pay at 
Year л is equal to pay at Year 1 + raises on 
Years 1,2, „йй — 1, the standard deviation 
of increments influences the standard deviation 
of pay. The standard deviation of pay is 

similarly a composite. The variation in pay on 
a given ycar is a function of the variation in 


roup, 
pany, and, if one 
of their usefulness to 


pay the vear before plus the variation in = 
raises between the 2 years. This is further iw 
plicated by the fact that, because of ен 
variance term in the formula for the stan y^ 
deviation of composites (т TE T 
+ 2010:), the influence of e; (the le a 
deviation of increments) on ø; (the stan es 
deviation of pay) depends partly on the ey md 
tion between increments and pay. Thus р | 
is another parameter in longitudinal data, "i 
or “who gets the raises?” na didi 

At this point four parameters, from ee 
of the company, have been identified, bá ple 
have, at least in simple terms, considera 
policy implications: 


1. Ё, the average pay, which represents © 
апу опе time the company's bid for UM 
and over lime, its assumptions about the 
of development. hich 

2. ox, the standard deviation of рау, v ipe 
measures the differences in the value М nce 
dividual assignments in the group, and he 
is primarily an organizational variable. ; 

3. т, the standard deviation of raises, out 
represents the company’s assumption т Р 
the size of the distribution of individual di 
ences in the group at any one time. seb 

4. т, the correlation between pay and ra ян 
which may reflect the operation of the pe 
pany's performance appraisal program ad 
time, and, in апу case, involves assump 0s 
about the consistency of goodness or useful”! 
of performance, 


hich 


ight 


s " ге 
These variables all have important W d. 
й 


ina company’s policy about compensation, ient 
they are complexly interrelated. Subsea" 
data will show something about how E o 
have in fact, and some theoretical mee i 
their relationships will illustrate their L these 
possible pay policies, First, look briefly at 
variables from the side of the individual. 1e 0 
First, £, to the individual, means the va ae 
his services in the market. Over time it "Mort 
the rate of his growth and development. Iking 
than that, since it is money we аге it e 
about, it is related to what he gets and W form 
needs, Since most companies pay on Ed 
of a percentage increase over time, the 
k is typically positively accelerated. a quite 
dividual’s consumption function has v im 
different shape, and this discrepancy 18 


in 


oe oi 


s 
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portant motivational implications. In passing, 
it might be pointed out that most people, when 
questioned, do not seem to recognize that they 
are actually on this positively accelerated curve 
of salary. This datum, which will not be gone 
Into here, points to the important area of how 
Pay is perceived—a psychological problem 
Which must be explored much further before 
the impact of pay on the individual will be 
understood. 

75, to the individual, gives him a measure of 
the range of possibilities, and, at any one time, 
limits his (local) aspirations. с; is a more direct 
index of the evaluation of specific efforts or 
accomplishments. It is probably here, if any- 
Where, that an incentive will appear. Finally, 
бы, from the point of view of the individual, 
treats the crucial question “Who gets the 
raise?" It can vary from “The one who got 
paid most before" (rri = 1.0) through “It will 
be distributed at random" (ғ: = 0) to “The 
one who got paid least before" (rj; = — 1.0). 
The motivational implications of these possi- 
bilities are clear. One should also notice that 
the stability of rą; over time may be an im- 
portant psychological variable. 


Empirical Data 


The first job that needed to be done was to collect 
some simple descriptive data about what happens to 
рау on the basis of which psychological interpretations 
can be made. Specifically, the means, standard devia- 
tions, and other parameters of the distributions of both 
Salaries and raises were examined for each year in a 
25-уг, period. The effects of various changes in these 
parameters will be discussed from the viewpoint of the 
individual and the organization. | 

‘Three samples of executives were used in this study. 
These samples have been identified as Companies A, 
B, and X. Companies A and B represent two groups 
of executives employed by the same large, diversified, 
manufacturing corporation. From , Company A, 90 
executives were selected on the basis of whether they 
had reached Level 20 or above on the company pay 
Scale? by January 1, 1963, and had at least 20 yr. of 
Service with the company. Company В subjects (5з) 
Vere selected from Levels 15-17 on the company scale. 
These individuals were approximately matched with 

Ss in Company A on the basis of age and years of 
Service, Company X is а large manufacturing cor- 
Poration in a process industry. From Company X, 90 
a 

* Level 20 of the Company A pay sc 
to ап annual income of about $40,000. 

* Levels 15-17 on the Company B pay scale corre- 
SPond to annual incomes ranging between $20,000 and 
822,00 


ale corresponds 


executives were selected in a quasi-random manner by 
choosing every zth man from among all employees 
whose service record extended bevond 15 yr. with the 
company and who earned more than $8,000 a year at 
the time of the study. 

The salary paid to each of the Ss for each year of 
employment was provided by the companies. The raw 
data were translated to annual salaries from the dates 
of raises in the earning history of each executive. 
Bonuses, stock options, and other forms of compensa- 
tion were not included in the salary figures. Anonymity 
was preserved for all Ss involved in the project, the 
research team having access to only the salary data 
and the service dates of each of the individuals being 
studied. 

A number of studies which have discussed salary in 
relation to time have attempted to correct the raw pay 
d for the effects of inflation and increased cost of 
living. Jaques (1961), for example, used the wages 
index, which is an index of the average national mini- 
mum wage for a normal working week, to eliminate the 
effects of inflation. By correcting his earnings data to a 
chosen period with this index, he felt that wages for 
different calendar years were made comparable. 

After preliminary efforts to adjust the salary of a 
subset of the samples used here for changes in the cost 
of living, this procedure was abandoned because the 
adjustments did not substantially change the results 
obtained. First, the relationship of the parameters over 
time was not measurably altered, the shape of the plot 
of the mean salary across calendar years being un- 
affected by these corrections. Second, the correlations 
between salary on different years remained about the 
same for the adjusted salaries as for the unadjusted 
salaries. Finally, the selection of any particular index 
for the purpose of adjusting the salaries would only have 
added a dimension of arbitrariness to the results. Since 
there is no standard accounting procedure for making 
this type of correction, but rather a number of such 
procedures, all of which produce unique results, the 
salary data reported have not been modified to com- 
pensate for changes in the cost of living. 


Notation 
The following is a sample of the notations апа ће 
statistics to be used in the analysis of the data for the 
5 Ss in each of the c companies. Note that a dot used as 
a subscript denotes the fact that summation has oc- 
curred over the factor usually represented by a letter 
occupying the particular position indicated by the dot. 
Also, a line above a symbol indicates that the particular 
notation represents an arithmetic mean. 
Е. рау for S s in Company c on Year l. 
i,-—increment (or decrement) in pay for S sin 
Company c on Year /. 

(k + ерау for S s in Company c on Year / +1. 
k.-—average pay for Ss in Company соп Year 1. 
k..—average pay for all Ss in all companies on 

Year /. | 
1,—average increment in pay for Ss in Com- 

pany с on Year t. 
i.—average increment in pay 

companies on Year /. 


for all Ss in all 
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(k + i)..—average pay for Ss in Company с on Year 
141 


ok.—standard deviation (SD) of pay for Ss in 


Company с on Year /. 


ci „—51) of increments in pay for Ss in Com- 


pany с on Year /. 


9 (+i), —SD of pay for Ss in Company с on Year 


+1 


9 (41),.—3D of pay for all Ss in all companies on 


Year 1 4- 1. 


TABLE 1 


NUMBER OF CASES IN THE UNSELECTED SAMPLE 


d. 
“| 


э - 


L Ii | 
© m 


m 


=й. 
E 


Year Company A | Company B Company X 
1919 1 

1920 1 2 
1921 1 | 2 
1922 3 1 | 2 
1923 5 2 | 2 
1924 7 2 | 3 
1925 7 6 | 4 
1926 9 8 | 5 
1927 11 11 8 
1928 17 16 | 9 
1929 19 19 | 10 
1930 24 23 | 16 
1931 33 31 | 20 
1932 40 33 22 
1933 43 36 27 
1934 46 39 28 
1935 51 45 34 
1936 60 54 | 39 
1937 70 66 43 
1938 74 71 49 
1939 77 75 | s 
1940 82 76 | 62 
1941 83 83 | 72 
1942 87 88 75 
1943 89 89 74 
1944 89 89 72 
1945 90 89 75 
1946 90 89 | 88 
1947 90 89 | 89 
1948 90 89 | 9 
1949 90 89 Е 
1950 90 Be 20 
1951 90 29 20 
1952 90 8b 80 
1953 90 39 99 
1954 90 89 90 
1955 89 89 Е 
1956 88 89 50 
1957 88 88 90 
1958 86 86 | 90 
1959 86 84 90 
1960 80 82 90 
1961 72 69 87 
1962 56 52 82 
1963 21 29 74 


\ 
ә 


Weighted mean, thousands of dollars 
Weighted S.D, thousands of dollars 


1938 40 42 44 46 48 50 52 54 56 58 60 62 


Fic. 1. Weighted mean and standard deviation 
of salary. 


Because of the longitudinal nature of the data, the 
sample size (N) varied from year to year. The fluctua- 
tion in N was caused by different starting and ter- 
minating service dates with a. company for the different 
members of a given Sample. Although salaries WEE 
available for as many as 45 yr., dating back to 1919 
the reliability of statistics based upon much of the dat» 
especially from the earlier calendar years, would i 
variable due to the small у characteristic of this period 
A Criterion of a minimum of 40 cases in each company 
on a given calendar year was adopted arbitrarily. Th! 
multiple cutoff for the sample size was selected in order 
that summary measures calculated on the data across 
companies for a given year would not be undu 
influenced by the variance of the scores from a single 
company. This restriction reduced the data available 
for analyaja to those for the calendar years 1938 throug 


E s 1 

Table 1 provides a list of the sample size for al 
calendar years on which data were available for ea€ 
company. 


Results 


Figure 1 contains а plot of &,, and øx, ү 
Weighted mean and standard deviation for cd 
the Ss in the three companies, for the calenda" 
years 1938 to 19624 Figure 2 contains indi 
vidual graphs of Ё, for each of the separate 
ELS DUET 


: d 

* The formula utilized for calculating the standar 
deviation of the combined samples from the indiv} aa 
company standard deviations can be found in Peat™ 
(1963, р. 64), 
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1938 1942 1947 1942 1957 1562 


CALENDAR YEARS 


Fic. 2. Average salaries by companies. 


companies, while Figure 3 contains individual 
graphs of ox,, for each company. Notice that 
the graphs of the average salary are all posi- 
tively accelerated increasing monotonic func- 
tions. The graphs of ть „ though less similar in 
appearance than those for K.., show generally 
increasing functions except for some minor 
fluctuations which disappear in the plot of the 
combined samples (т). The fact that the 
curves of c; , all turn down at the end is partly 
a function of shrinkage in the sample. 

The graphs of k. indicate that on the average 
the contribution or value of the executive to 
the organization, as reflected by the magnitude 
of his salary, increased logarithmically. From 


а 50 
a 40 


зо 


HUNDREDS 
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STANDARD DEUIRTIUN OF 


SALARIES 
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1942 1947 3332 Аз? 


CALENOAR YEARS 


1938 


Fic. 3. Standard deviation of pay by companies. 
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1938 1942 1947 1952 1957 


CRLENDRR YERRS 


Fic. +. Weighted mean and standard deviation 
of increments in pay for combined sample. 


1962 


the standpoint of the company, the shape of 
the curves means a policy of something ap- 
proaching a constant rate of increase in salary, 
allowing the absolute amount of increases to 
change logarithmically. | 

This logarithmic trend in the magnitude oi 
the increments is displayed in Figure 4, which 
is a plot of the weighted mean and standard 
deviation of increments based upon the com- 
bined samples. The sharp drop in magnitude 
of these parameters for the last two calendar 
years is probably an artifact due to the retire- 
ment of a number of executives. (The effect of 
losing data from the sample at the end of an 
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INCREMENTS 


(IN HUNDREOS OF DOLLAR 
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mean G 
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YEARS 


1938 1942 194? 
CALENDAR 


Fic. 5. Average increment tn pay by compan} 
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STRNORRO DEVIATION ПЕ INCREMENTS 
(IN HUNDREDS OF DOLLARS) 


1942 1942 1952 1957 1962 


CALENDAR YEARS 


Fic. 6. Standard deviation of increments 
in pay by companies, 


S’s career is a marked effect on the 
increment and the dispersion of increments 
when the progression of raises is geometric.) 
The same phenomenon appeared in Figure 3. 

The behavior of raises is further portrayed 
in Figures 5 and 6, which describe 7. and e;, 
as a function of calendar years. The pattern 
of raises over time is quite similar for the three 
companies, although the magnitudes di 
siderably among the groups, 

The relationship between Ё, and i. ds 
graphically demonstrated in Figure 7, When 
one considers pay on a given year as pay on the 


average 


fier con- 


МЕЙН SALARY FOR co, a 
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Fic, 7. Average pay and average increment, 
Company A, 1945-1954, 


1953 


previous year plus an increment, and when ee 
sample size on successive years remains on 
stant, k.e on Year л equals the sum of E. ans 
le for Year п — 1. That is, one can consider 
Pay on any year as representing starting ed 
plus the cumulative increments awarded оу : 
time. The change in Ё, from year to year wher 
N is constant is caused entirely by changes m 
Le If there is a fluctuation in X; e p 
means will not be comparable. Figure 7 eh 
plot of Ё А for the calendar years 1945 Шр 
1954. This period was arbitrarily chosen à 
cause the sample size remained constant gom 
this 10-yr. span (ү = 90). The curve of oe 
cumulative z 4—that is, the ia increment? 
Summed each year across all preceding years б 
is also plotted. It is immediately apparent ue 
the shape of the two curves is identical, ae 
though they are represented on differe 4 
Portions of the dollars dimension, Salary 
Year л is the sum of all raises plus a consta! 
(the starting salary), | $ 
Figure 8 contains a plot of the index ch 
skewness of the distribution of salaries in ea 
of the companies for each of the 25 yr. I^ 
Figure 9 contains а plot of the skewness of dd 
distribution of increments, Figure 8 pee 
that the distribution of salaries was positive? 
Skewed every year in Company X, pu е 
every year in Company A, and three-quarte 2 
of the time in Company В. This means ic 
few individuals received salaries far above th 
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Fic. 8. Skewness of the distributions 
of salaries by companies. 
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Fic. 9, Skewness of the distribution 
of increments by companies. 


salaries paid to the majority of the executives 
in the group, especially in Company X, in 
which departures from normality are uniformly 
large. 

The high degree of skewness was expected 
in Company A and Company X because there 
was no ceiling on the salaries represented in 
these groups. The positively skewed distribu- 
tions in these two companies are reflections of 
the pyramidal structure at the top of the organ- 
ization; that is, skewness was based upon 
salaries across levels of the organization. In 
Company B, however, limits on both the 
minimum and maximum salary were imposed, 
thereby restricting the range of salaries. In this 
case, skewness is a reflection of the distribution 
of intralevel pay. 

Because of the high degree of skewness 
present in the raw salary data, the arithmetic 
mean, Še cannot be considered alone as an 
accurate reflection of central tendency. The 
median was calculated for the distributions of 
Salaries for each year. Figure 10 contains a plot 
of the medians for each company. The shape of 
these curves of median salary is quite similar 
in form to those displayed in Figure 2. Some 
difference appears in the plot for Company X. 
Although the curve for the medians of Con 
Pany X still shows a decided upward trend, the 
linear component seems to have increased after 
the effect of the high degree of skewness of the 


distributions has been removed. 
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The reason for this flattening of the curve 
can be explained by the fact that the later 
years in Company X, that is, those subsequent 
to 1953, were characterized by the most highly 
skewed distributions of salary for all com- 
panies. The effect of these positively skewed 
distributions was to elevate the value of the 
arithmetic mean for these years, which thereby 
imparted the curvilinear upswing in the graph 
for Company X over the most recent years. 
This effect was removed by utilizing the 
median which produced the largest adjust- 
ments in central tendency for those distribu- 
tions which were most highly skewed. 

The plots of both the medians and arithmetic 
means show that the highest average salary 
was paid by Company A, the second highest 
by Company B, and the lowest by Company 
X; that is, the companies are ordered the same 
way on the basis of average salary regardless 
of which measure of central tendency is used. 
Since Ss were selected on the criterion of 
relative salary for inclusion into Companies A 
and B, it was expected that the average salary 
for Company A would be higher than that of 
Company B for the year in which the salary 
criterion was measured (1963). However, 
Figures 2 and 10 both indicate that the average 
salary for Company А was higher than that of 
Company B throughout the 25-yr. period 
studied. Furthermore, the difference in the 
average salaries of these companies progres- 
sively increased over time beginning with 1938. 
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Fic. 10. Median salaries by company. 


TABLE 2 


CORRELATIONS BETWEEN MEANS AND STANDARD 
DEVIATIONS FOR TOTAL SAMPLE AND 
EACH INDIVIDUAL Company 


| 
Ms апа SDs | r 
| 

k.. and гь. 996 
Èa and cx, 844 
Ев and ky .929 
kx and ez 984 
i.. and õi., | -900 
1.4 and ei, | -905 
i.n and cip 814 
ix and six | 817 


In terms of career pay, one might consider the 
curves of the means of yearly salary 
stituting separate paths for the 
toward the criterion of pay in 196. 
when the standard deviation for 
considered in conjunction with t 
great deal of overlap is found 
individuals from each of the two companies, 
and access to the higher salary brackets was 
obtained by individuals w 
salary histories. 

Figure 1 also indicates that there is a very 
close correspondence between the relative 
magnitudes of Ё. and 7L. throughout the 
period studied. This high correlation is also 
characteristic of the pairs of Ё. and ор, for 
each company. Table 2 contains the Pearson 
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Fic. 11. Coefficient of variation (Д/с) 
for combined sample. 
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product-moment correlation coefficients cal- 
culated between the pairs of means and RE 
dard deviations for the combined sample an 
each of the individual companies. These very 
high correlations imply that as the average 
salary increased, so did the dispersion of those 
salaries. f 
Another indication of the high degree 9 
correlation between Ё. and ср, appears _ 
Figure 11, which is a plot of the coefficient » 
variation for the combined samples (E. / ei... 
às a function of calendar years. Figure 12 m 
tains similar plots of the coefficient of are 
tion (k.-/ox,.) for the individual соры 
Whereas large differences in magnitude of th 
index existed for the data from individus, 
companies, the range of values of the nine 5 
was quite restricted for the combined samp 68 
Тһе range of this index for the combine 
Sample was 0.76, with a high value of 2.79 p 
à low value of 2.03. The average value of th 
coefficient for the period between 1938 an 
1962 was 2.42, | 
The disparity in the shapes of the individu’ 
curves and the curve based upon the combine 
Sample can be explained by examining each б 
the components in the coefficient. The n" 
merator, E, represents the average of а Le 
of means, and hence its magnitude is boun! tds 
by the values of the separate f.,’s. The pene 
tion of the combined samples, сд. , represen я 
the total or summed variation across all co™ 
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Fic. 12. Coefficient of variation (Ё/00) 
by companies. 


A PsvcHoLocicAL Stupy ОЕ Pay 9 


panies, and was larger than any of the indi- 
vidual company variations, ør „ The increase 
in the denominator was responsible for the 
reduction in value of the coefficient calculated 
on the combined samples. 

"Table 2 also contains the correlation between 
the pairs of means and standard deviations of 
the increments for both the combined and the 
individual companies. Again, high correlations 
were found to exist for all pairs of i. and о; 

These results indicate that as the average 
Salary and average increment increased over 
the years, so did the spread in salaries and 
increments, respectively. A high degree of 
correspondence was discovered between the 
relative magnitudes of Ё. and ок; the dis- 
persion of salaries remained between one-half 
and one-third of the average salary. 


Discussion 
A variety of specific things stand out in 
these data. The first of them is the remarkably 
smooth, positively accelerated curve of total 
pay, and its consistency from sample to 
sample. This means that the executive can 
expect, on the average, larger earnings each 
year. From the point of view of the company, 
it could mean two related things: First, a 
cautious reluctance to pay much in the early 
vears until a man has shown his worth. Second, 
to the extent to which salary measures the con- 
tribution to the company, the assumption that 
the contribution increases geometrically. It is 
also an expression of a kind of Weber-Fechner 
assumption that the raise must be a constant 
function of the absolute level. In many cases 
this has probably become the routine practice, 
rather than an expression of the more explicit 
elaborate rationale. In the extreme, it is hard 
to see the shapes of these curves as accurately 
reflecting contribution. Salary curves within a 
Company generally build up smoothly to the 
chief executives. Yet the tremendous variation 
in the salaries of chief executives, published 
Under Securities and Exchange Commission 
Tegulations, defies an easy explanation in terms 
of variable contribution either within an in- 
Ustry or across industries. 
As far as these data show, t 
M pay displayed here may on 
Which held these Ss in the compa! 
Enough for them to be included in thi 


he steady increase 
ly be the factor 
ny long 
s study. 


Those who left, conceivably could have had 
quite different curves. Other data on pay make 
this unlikely. 

A variety of curves of average pay over time 
is possible. A company might choose to keep 
the average increment roughly constant and 
the average pay curve linear. This would have 
different assumptions about the labor market 
and worth to the company, and about the 
motivation of employees. Or it might operate 
a declining average raise each year, hoping to 
hold individuals in early years with large 
raises. The choice of a rate of change in the 
curve has important motivational conse- 
quences, even though total cumulative career 
pay is the same. One might notice that the 
curves shown here do not fit the individual's 
demands very well. That is, pay is low when 
Junior’s teeth are being fixed, sister is going 
to college, and the mortgage payments are due. 
After these crises have passed, pay increases. 

It is also clear in these data that the variance 
of pay tends to increase as the average in- 
creases. This finding is in agreement with 
Brenner and Lockwood (1965). One startling 
result of this is that executives’ salaries become 
more dissimilar over time, and, hence, an 
individual’s position becomes more and more 
fixed relative to his fellows. If с increases and 
N stays constant or shrinks, it takes a larger 
and larger increase in an individual's pay to 
change his rank order. This phenomenon may 
have important implications for individuals 
needs for prestige and recognition. . 

It is also important to notice that the vari- 
ance of pay is a function of two things: (а) the 
variance of increments, and (b) the correlation 
between raises and salaries. The variance of 
pay at Year п represents the variance of start- 
ing pay plus some fraction of the cumulative 
variance of the increments. The size of this 
fraction is a function of the nature of г. The 
formula for the variance of a composite (т 
= o? o + 2oxoirsi) makes it clear that the 
increase in the variance of pay at Year n is 
smallest when ға: has been negative, and largest 
as гы approaches +1.00. We have probably 
underestimated the psychological possibilities 
in the cumulative character of pay. 

It becomes clear that a variety of p: 
logically meaningful parameters of pay—the 
size of k at a given time, the shape of the curve 


sycho- 
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of Ё, the size of o;, the size of c; at a given time 
and its rate of change—can be varied by a 
company without increasing the total salary 
expense over time. Yet the motivational lever- 
age of alternative forms at constant cost has 
had remarkably little empirical investigation. 
The measures of skewness and kurtosis in 
these data tell us more about how to handle the 
data themselves than they do about general 
characteristics of pay. Two of the samples (A 
and B) are from two groups of levels in a 
company. Under these circumstances it is hard 
to generalize the meaning of distributional 
shapes. The third (X) is, roughly, a random 
sample of a second company. Can we gener- 
alize? Both companies are superficially typical 
of industry in general in pay policies and 
administration. In this sense they are repre- 
sentative. However, the crucial question is 
whether they are representative on the more 
detailed internal parameters of pay—o,, у, the 
rate of change of ai, and the like. Since there 
are no data on population characteristics for 
these variables, it is impossible to answer this 
question. It is hoped that subsequent research 
will report on these important Parameters of 
pay so that psychological constructs in this 
area may be built on sound empirical bases, 


2. THE CORRELATION OF PAY WITH 
PAY OVER ТМЕ 


Among the things seen 


chapter was a marked pro 
Over time, in the 


in the previous 


equal to pay on Year 
to 2. For the individual the raise i; 
of merit. Raises partake of the whole field of 
variable reinforcement in psychology, and 
much of the incentive character of pay must 
reside here. Further, as raises accumulate, they 
idctate relative position in the array of salaries, 


5 the reward 


with its attendant implications for need se 
faction in the form of prestige, recognition, an p 
achievement. (b) From the side of the ое 
pany, the relation between raises and past js 
uncovers some implicit assumptions about if 
consistency of good or useful performance. © 
raises are held to be related to [en aime = ti 
a position that is often, though not invartab ji 
taken—the relation of pay with pay becom d 
а measure of consistency of s pipe 
makes contact with a long tradition of — 
and theory in differential psychology. (©) soli 
correlation of pay with pay can also be ship 
аз à problem of prediction. If the gea et 
between рау and performance mentior à 

above is assumed, as Brenner and Lockwo ts 
(1965) do, pay can be seen as an inte 
criterion in the Thorndikean sense (Thorndi of 
1949) as well as a predictor. (4) The shape : 
the curve of the correlation of a criterion es 
with lagged years has interesting possibilit 

Various studies (Fleishman & Fruchter, к, 
have suggested shifts in factor [райы 8 
Performance over time. In the present e Ж 
the executives move, over time, pma 0 

Variety of levels, It has often been sugges ire 
that different organizational levels yet 
quite different skills, If this is so, and if e 
represents performance, the curve of predic A or 
of pay by past Рау may show discontinuities g 
inflections as a function of these chang 
factors associated With organizational pun 
ture. (е) Finally, as has been pointed out 9 
fore, the composite character of pay 19 gm 
important. Pay this year is last year's us 
plus a raise, Consequently the came y 
pay with pay is appropriately represented ** 
the formula for composites, 


PFA 


" Tk с 
кю = —= ' 
м Yo? cro? + 20,0 


апа! 
Where Ё is the pay on the previous y pim 
the increment. (The psychological meaning | 
these parameters is briefly discussed „А 
Previous chapter.) A glance at the pet 
makes it clear that when rg; = 0, the cor 
tion between Successive years is determine e 
the ratio of the two variations, that is, V 
fki = 0, 
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Ө ж ЫЫ ж 1.0, тво = 1.0. In terms of 
fist eden eh а ales two policies mean 
is lane » either ^ distributed at random 
the Ties : Y past salaries or that those with 
bns alaries get the biggest raises. Obvi- 

sly, all the other policies between rz; = —1.0 
us Лы = +1.0 are possible. This dissection of 

€ formula for the correlation of composites 
emphasizes the role of r;;—the rules for award- 
ing raises to employees with different salaries— 
as a major factor in the control of the correla- 
tion between salaries on different years. In 
Chapter 1, the role of this same г; in the vari- 
ance of composites was stressed. Among the 
Measures normally monitored in wage and 
salary administration, this vital variable has 
been largely overlooked. 

In the only other longitudinal study of pay 
that comes immediately to hand, Brenner and 
Lockwood (1965) suggested that pay becomes 
a better predictor of pay as length of service 
increases. In their report on 52 aircraft engi- 
neers over 20 yr. they showed an increase in 
the correlation between adjacent years as 
tenure increased. This pattern might be inter- 
preted on the basis of (a) consistency of 
performance plus (b) an increasing awareness 
of the relative value of each individual. The 
empirical fact of the relationship can be 
examined in the data presented here. 

The matrix of intercorrelations of each year 
with each other year was calculated for each 
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Fic. 13, The correlation of pay with pay over lagged 
years. (Data from Brenner and Lockwood, 1965, are 
Plotted with asterisks for comparison.) 


of the three groups of managers previously 
studied. Figure 13 shows the correlation of a 
final level of pay—taken as a criterion—with 
pay on earlier years. The pay on years 1956- 
1962 was chosen as the criterion. Salaries on 
these years were correlated with the pay 2 
years before (ie, 1954-1959), 7 years, 
12, etc. Each point on the graph represents the 
average of the correlations for each year’s 
salary in the criterion period with the salary 
x years previous to it (e.g., the correlation for 
2 lagged years represents the average of the 
correlations between 1961 and 1959. 1960 апа 
1958, 1959 and 1957, . . ., and 1956 and 1954) 
This average was calculated by converting all 
the intercorrelations to з scores utilizing 
Fisher's transformation, averaging the z scores 
and converting the average z to a figure for a 
product-moment correlation coefiicient.® 

It is immediately evident that there is a 
steady decrease in the predictive power of past 
pay in all three companies. This decline in 
correlation implies that the executives studied 
have changed their relative positions with 
regard to the amount of pay they receive, and 
that the amount of change which occurred 
increased over time. Company X seemed to be 
the least affected. The correlations are uni- 
formly higher throughout the 27 lagged years. 
The relative pay positions in this company 
seem to have remained the most stable. Com- 
pany A and Company B show very similar 


5 The use of the Pearson product-moment correla- 
tions was deemed permissible despite the high degree 
of skewness present in the yearly distributions of salary 
because the direction and magnitude of skewness was 
fairly similar across the years (see first chapter for 
rt of the index of skewness). Ghiselli (1964) points 
range of values of the Pearson r 
y only if 


a repo 
out that the maximum 
will be affected by departures from normalit 


the distributions have different shapes (i.e., if there 
are large differences in the skewness of the distributions 
of the variables being correlated). In Company A the 
the index of skewness was 1.24, with all but 
one distribution being positively skewed. In Company 
B, 28° of the distributions were negatively skewed. 
The rest of the distributions had index values greater 
than 0.0, and the range of values for skew was 1.56. 
And in Company X all distributions were positively 
skewed. The range of the index was 1.66. It will also 
be noted that the lagged years run to 27. This final 
point runs beyond the requirement of 40 Ss in each 
group. This is the only computation utilizing these 
data. It is included here because the 27-yr. point is a 
smooth continuation of the line generated by the 


earlier points. 
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Fic. 14. Correlation of Pay with pay for three 
different service groups for lagged years in the period 
1958-1949, 


sharp decreases in correlation for the first 7 
lagged years. The rate of decline stabilizes 
thereafter, so that the slopes of the curves for 
all three companies are somewhat similar, 

For the purpose of Comparison, the data 
presented by Brenner and Lockwood (1965) 
are plotted in Figure 13, Their published 
matrix of intercorrelations was handled in a 
manner identical to the data reported here, 
Only 17 yr. of lag are available in the Brenner 
and Lockwood data. 
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Fic. 15. Correlation of Pay with рау for three 
different service groups for lagged years in the period 
1951-1942, 
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г " three 
lic. 16. Correlation of pay with pay E »erio 
different service groups for lagged years in the | 
1945-1936, 


The decline in correlation of pay with P 
тау be a function of particular stages " B 
man's Career—or, in other words, of acne 
tenure. To test this hypothesis, the ye 
A sample was divided into three groups m 
different dates of employment. The gro nd 
Were hired between 1919 and 1929, 1930 F 
1933, and 1934 and 1940. The three e 
were chosen arbitrarily to give roughly p" 
Vs and a wide chronological span. al 
were computed Separately for each ane 46. 
the results appear in Figures 14 through 
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Fic, 18. Actual correlation of pay with pay over 
lagged years compared to an assumption of random 
raises. (Company A, 1951-19-41) 


These figures show the rrei) for lagged years 
for three selected chronological periods. The 
plots for all three service groups in a given 
chronological period are very similar, The three 
periods are rather different from one another, 
but within each the three service groups are 
remarkably similar. There is no apparent effect 
of tenure on the correlation of pay with pay. 
Brenner and Lockwood compared the correla- 
tions of adjacent years as tenure increased and 
found a positive relationship. This would lead 
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Fig. 19, Actual correl 
lagged years compared to an 
raises, (Company A, 1958-1948) 
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Fic. 20. Actual correlation of pay with pay over 
lagged years compared to an assumption of random 
raises. (Company B, 1951-1941) 


one to expect the 1919-1929 group to have the 
highest r's in a given period, the 1930-1933 
group next, and so on. Figure 17 presents the 
data for each company in the same form as the 
Brenner and Lockwood data. It is clear that 
the companies sampled here do not show the 
phenomenon. 

What causes the slope of the curve of таа) 
time? What causes the decline in the 
ay? The correlation 
To 
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predictability of pay by p 
k(k + i) is importantly influenced by rx: 
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lagged years compared to an assum 
raises. (Company B, 1958-1948) 


14 M. Harz, E. E. GHISELLI, AND M. E. Сокрох 


CORRELATION 


o 
o 


o 
h 


соо асти 


* * ә THEORETICAL 


+ 2 з о $ 


LRGGED 


8 э i10 


6 ? 
YERRS 


Fic. 22. Actual correlation of pay with pay over 
lagged years compared to an assumption of random 
raises. (Company X, 1951-1941) 


examine the effect of this correlation on the 
correlation of salaries for different years, fpi 
was assumed to be zero, and а Series of theo- 
retical curves was computed from the ratio of 
the variations Crato = с/с? 1 аг) for 
lagged years. Figures 18 through 23 show the 
relationship between these theoretical Curves 
assuming a random distribution of raises and 
the observed correlations, The theoretical 
Curves provide a good fit for Companies A and 
B subsequent to the mid-50s; before that they 
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do not. Company X data did not fit ш 
theoretical assumption consistently for any и 
the periods. In 1953, Companies A and B sc 
duced a change in performance evalua - 
which was probably responsible for this chang : 

Prior to 1953 the appraisal was, roughly d Е 
the "is he а good man?" type. After М 
very serious effort was made to evaluate ips 
contribution of the man on the job. Since ns 
potential contribution of jobs and the ш 
of accomplishing them varied widely, ees 
Since assignment to jobs had а random pant 
acter due to the historical accidents of vim 
and availability, a random clement was intr 
duced into appraisal and hence into рау» s 

The effect of the change in policy is € 
Seen in Figure 24, which shows the actua 948 
for all pairs of Successive years between 19 ó 
and 1958 and for each of the three crim 
The гь; pre- and post-1953 for each of the t 
Companies appear in Table 3. Company y 
remains fairly constant on the average. gl 
panies А and B change markedly. The aie 
siderable instability in 7}; overall might а 
be noted. 
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TABLE 3 


AVERAGE CORRELATION OF SALARIES AND 
RAISES BY COMPANY 


Fri 


19-48-1953 


А 1951-1958 
Company А 42 —.06 
Company B .38 —.18 

32 EX 


Company X 


An attempt was made to discover whether 
any clusters of career salary patterns existed 
by factor analyzing the intercorrelations among 
salaries over the years. The purpose of this 
as to determine whether the correla- 


analysis wa 
tions between pay distinguished different 


groups of individuals. The procedure utilized 
was analogous to what Guilford (1954) has 
described as the Q technique of factor analysis. 
The results of this procedure indicated that 
greater than 95% of the variance could be 
accounted for by a single factor. This factor 
represented the salary previously paid to the 
employee. That is, groups of executives could 
not be differentiated because each individual’s 
salary was composed of the same two com- 
ponents: past pay and an increment. Other 
attempts were made to discover additional 
factors by alternative procedures, but so far 
these attempts have been unsuccessful. 

The correlation of pay with pay declines 
regularly and fairly rapidly. Companies A and 


B behaved similarly, with a point of inflection 


probably associated with the shift in perform- 
ance evaluation policy mentioned previously. 


Company X and the Brenner and Lockwood 
data show similar declines probably best de- 
scribed by straight lines. The consistency 
within each of the two pairs of data over the 
Same period strongly suggests that rki 15 8 
function of company policy and not of the 
exigencies of historical periods. Several things 
flow from this decline in Лк? 

(a) The decline is smooth. Except for the 
curve in Companies А and B there are no 
serious breaks. This does not suggest—though 
it does not rule out—shifting factor loadings 


from management level to management level. 
be thought of as the 


The correlation can also | n Ye 
ratio of common factors 10 the job in Years 


and k+ ito the total number of factors in the 
2 yr. This view, too, leads to the suggestion of 
a relatively smooth change in job factors from 
year to year. 

(b) It should be pointed out that these data 
are not ideal for this analysis of factors. The 
pay confuses changes in level and penetration 
of the salary range for the level. Some of the 
smoothness may be an artifactual result of the 
confounding of these two sources of increases 

(c) The sharp decline in correlation rises 
questions about the qualities for which em- 
ployees are paid. We generally expect a fair 
correlation in the performance of mature in- 
dividuals over time. The decline in correlation 
here suggests either that this accustomed con- 
sistency of performance is absent or that the 
pay or raises (or both) are unrelated to per- 
formance. If the latter is true it has real 
implications for the view of pay as a reward in 
the traditional model of behavior change. 

(d) While the correlation between pay and 
pay declines, it is still substantial. From the 
side of the company, it provides a real imple- 
ment for career planning and development. 
From the point of view of the individual, the 
substantial correlation means a stable relative 
position in the arrays, with its attendant 
motivational implications. 

The approach of rsi to Q has disturbing 
psychological implications. Baldly, it means 
that raises are randomly distributed with re- 
spect to performance. It echoes the lack of 
consistency in (rewarded) performance just 
mentioned. The awareness that having done 
well is no better predictor of the future than 
having done poorly must take most of the 
incentive out of the pay. Even when, as has 
been suggested in Companies А and B, the 
pay is given not for individual performance but 
for performance on the particular job with a 
random assignment to jobs, the heart of the 
incentive is gone. It takes only a little algebraic 
manipulation to see that if re; = 0, rii = 0. 
On the job it must take relatively little ex- 
perience with the system to realize the same 
thing. 

Psychologists are seldom in a position to say 
how data ought to be in the real world. Here 
it seems possible. The correlation ki ought to 
be positive and significantly different from 
zero. Two lines of reasoning support the point 
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of view: (a) It would better represent a 
consistency of performance which. probably 
exists. (5) It would rescue the individual from 
the morass of insecurity engendered by the 
complete lack of prediction of raises by raises. 
Psychologists must consider the relation be- 
tween the value of r}: and techniques of 
performance evaluation. The old (bad) model 
was to give a man a raise because you liked his 
looks. The next year his looks had not changed 
and he got another. The correlation i, i equaled 
11.0, and rz; approached it. As more and more 
factors are introduced into performance ap- 
praisal, the denominator of the formula for 
correlation stated in terms of common factors 
grows, without any necessity that the numer- 
ator keeps pace. Only a most vigilant manage- 
ment of the appraisal System will keep it from 
vitiating the incentive in the pay policy. 
Brenner 
demonstrated a positive rel 


Late pay may be thought of as r 


presenting 
Seasoned and selected perform 


ance, while early 
of the untried and in. 
experienced, All that can be said is that these 


data do not support the hypothesis. The cor- 
g values seem to be 
ular Company policies 
of individuals, 

tion of pay with pay 
cal leverage available 
in little-noticed pa- 
тк is an extant 
he dispersion of 
tly, control Over 
Голка is a function of о. 
П given to о, before in terms 


К onal leverage inherent jn 
policies about raises, Patton (1061) has 


emphasized the need for recognizing and ге- 
warding outstanding performance With raises 
which are directly related to the executives’ 
contributions for the year, Patton’s thesis is 
intimately connected with the Motivational 


aspects of o; However, little is saiq about the 
effect of т; on relative pay 


to be a crucial motivationa 
to provide a handle for the ma 
relative pay positions, It is Surely not un- 
important to point out that this Motivational] 


Attention has beer 
of the motivati 


objective of the company can be achieved p. 
out suggesting a change in Ё or i, the salary bill. 


3. A STATISTICAL MODEL ОЕ CERTAIN 
PARAMETERS OF Pav 


We have seen the behavior of certain e 
rameters of pay over time, and the ae 
of pay viewed as a Composite variable, that à 
the fact that pay on any given year is sed 
lent to pay on the previous year plus or mee is 
Some increment (№, = kn-14:). Based upon ea 
premise one is able to restate the formulae f 
composites so that the standard deviation 
Рау on succeeding years is 


9kei = Vos? +o? + 2ске, 


; wet rears 15 
and the correlation of pay on successive yea 


o + Oki 
Tk (ki) out ` 

The merit of this conceptualization is a 
the parameters of pay are united pum, 
ously in a statistica] model of composite en m 
ables, thereby formalizing the relations TP 
which exist among the parameters. Presu x 
ably, at least two areas of Mec. 
research should be enhanced with the айры 
of this statistica] formulation of pay. йе 
rather than treating pay holistically (тас n 
Scopically), future research on compensata 
may be designed to determine which of its 
many parameters of pay is responsible for d 
relation to other variables. For example, he 
Program of research Structured in terms of ory 
statistical model could facilitate the sd od 
of the linkage between various спава 
of pay and its incentive value, Hence, ore 
model provides the basie constructs for a m 
microscopic analysis of pay. ion fü 

Second, this mathematical formulation “om 
itates 2Perationalism in the realm of Kos 
pensation practices, Different compensi ig: 
policies may pe defined in terms of the ped 
ulation of specific Parameters. As a io o 
quence of these refinements, the Б different 
Pay may be predicted as a function of di ted 
remunerative plans, This chapter is devo*® i 


cil- 


+ this 
exploring the usefulness of the model. S the 
second area of defining and predicting 
effects of different compensation policies. 
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The mathematical definition and the psycho- 
logical meaning of each of the parameters 
identified in the above formulas have already 
been discussed in Chapters 1 and 2. The vari- 
ables involved can be divided into several 
types for the present analysis: 


1. Some are measures of extant quantities 
at any given time, and hence are unavailable 
for manipulation. Examples аге Ё and ox, the 
mean and dispersion of last year’s salary. They 
are largely disregarded here. 

2. A second group is made up of the variables 
Which the company manipulates as it tries to 
make its compensation do whatever it is that 
is aimed at. For instance, с; and г, the 
variation in raises and in who gets them, stand 
Out in this class. Since they are manipulable in 
this sense, they will be treated here as if they 
vere independent variables. 

К [^R eed group is made up of composites 
rst two: окы and уку, for instance, 
measure the effect on last year's salaries of the 
мар in which this year's raises were awarded. 
E tie ioa hiere as dependent variables 
| asons. First, they аге the direct 
a of Manipulation of the independent vari- 
re sat ie they bear much of the psycho 
gical impact of pay. ør; brackets the scope 
of an individual's sal: АР а кра 
» an individual's salary expectations; re 
contains the probability that he will change 
his relative salary status over adjacent fiscal 
periods, 


It is worth noticing that 2 does not appear as 
а variable on either side of the equation. This 
18 important, since Zi represents the increase 
in the wage bill. Above some discriminable 
minimum, Zi, the cost of raises is not an im- 
portant variable in determining the way the 
things management manipulates (o, ть.) affect 
the psychological variables (oxi fiai). 1, Of 
course, has a real influence on Ё, since pay over 
the years is simply the starting salary plus the 
accumulation of increments. E 

Let us look at some compensation policies 
in these terms. By “compensation policy” we 
Mean the company’s active manipulation of 
Pay to achieve specified quantitative relation- 
Ships among salaries (and hence psychological 
effects on the modification of behavior). We 
Will examine some policies with respect to the 
two independent variables c; and ri; On the 


dependent variables c; and гы, and con- 


sider the psychological meaning of the 
resultants. 
Policies Affecting o; 

Ѕ1. тл = с, = Ci —:::— о. This policy 


maintains equal standard deviations of the 
increments each year. The same individual may 
not receive exactly the same increase each 
year: this is a function r;;, not сх. The amount 
of an individual raise is not strictly determined 
by this policy. The employee's aspiration as to 
the absolute amount of salary he can earn is 
still nearly unlimited. However, the relative 
amount he can be awarded is fixed in relation 
to the raises given to fellow employees regard- 
less of the distributions of relative contribu- 
tions and development of individuals from 
year to year. The effect on incentive would 
seem to be a function of the absolute size of 
c; selected; the larger the value of oi, the 
greater the ability of the company to reward 
its employees differentially. 

$2. су < 0, © т X © б. This policy 
indicates (ас the magnitude of e, increases 
each year, It is likely to oceur when each 
individual is awarded an Increment propor- 
tional to present salary. That is, а linear 
transformation of the salaries produces a non- 
lincar (logarithmic) transformation of the 
values of ø; Such a policy might 
designed to recognize that the relative con- 
tributions of some individuals are increasing 
while those of other employees are decreasing 
or remaining the same over time. These condi- 


ould increase the value of с; each year 
vely correlated 


also be 


tions w 
assuming that raises were positi 


with performance. 

S3. oi, > 042042772 Fine This policy 
is designed to steadily reduce the dispersion of 
increments each year. This type of policy would 
probably be reserved for а situation in which 
there was a definite ceiling on performance so 
that with time each person's contribution be- 
comes more like that of others. This policy is 
not totally unrealistic; the requirements of 
some standardized jobs demand that an at- 
tempt be made to equalize the wages of all 
workers performing the job. However, this 
policy probably does not represent. common 
practice, especially among salaried employees. 
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Policies Affecting ткн 


Ri. rz; = a, where 0 < a < 1.00. That is, 
increases in pay bear a constant positive 
relationship to pay on the previous year. This 
type of policy is both familiar and very reason- 
able. First, it represents the fact that, in 
general, relative performance is positively 
correlated over time. This is usually reflected 
in the stability of relative pay over the years. 
Second, many organizations award raises which 
are approximately constant fractions or per- 
centages of current salary. In this situation, the 
value of rz; approaches 1.00, in which caser;;, ;; 
also approaches a value of 1.00. Note that the 
higher the value of ;.;, the more stability present 
in relative pay over time. This stability would 
appear to have clear motivational implications. 
Regardless of any effort one makes to change his 
relative monetary status by means of spurts in 
performance, pay position will remain rela- 
tively fixed over time whenever the value of ғ; 
approaches 1.00. 

R2. гь = 0.0. That is, increases in pay are 
randomly assigned with respect to pay on the 
previous year. This type of policy ignores any 
persistent trends in relative performance over 
time and could stem from several circum- 
stances: (а) the standards used by manage- 
ment as a basis for awarding raises vary from 
year to year (see Chapter 2) ; (b) the individual 
moves from one job to another almost every 
year, each job having different requirements. 
The individual's talents for one job may be 
quite inappropriate for the tasks of another 
and so he would perform well on one job and 
poorly on the other; (c) performance is meas- 
ured without any reliability at all; therefore, 
evaluation of an individual's performance 
varies from one year to the next, 

R3. ri = b, where — 


ause this policy dictates 
that the largest raises be awarded to those indi- 
viduals with the smallest Current salary, 
whereas the individuals who currently receive 
the highest salary 


would be awarded the 
smallest raises. This may also occur where some 


people have reached the upper р рачай. 
their salary brackets. The amount of md 5 
tion that can be awarded in the form of ges 
is small. Any major recognition of their A 
formance will most likely be in the form of ê 
romotion. не 
i In this manner, we can examine ems 
compensation policies in terms of a pere 
model of pay. Certain remunerative po on- 
will be investigated by examining ee E 
figuration of independently manipulable P 
rameters required to maintain such policies jis- 
the effects of these policies on both паса 
persion and relative stability of salaries and 
time. The object was to obtain an pica] ; 
ing of the long-range effects podie ay 
specific modifications of the parameters О! pud 
and was not concerned with the peu 
history of compensation practices of any 8! 
(existing) company. iter 
In order to do this, a group of n arm 
programs were developed which iuc at 
the statistical formulas which sensit 
model of pay as well as a series of ш 0 
for systematically modifying the parametel an 
pay in order to simulate a variety of compe id 
tion policies. Simulation of the different “ing 
pensation policies was accomplished by i ues 
the values of т; and туу. Policy S1 was simu n is 
by keeping the value of с; constant, ae oul 
equivalent to initial magnitude, throug em 
the calculations. Policies S2 and 53 “7 
simulated by successively increasing or one 
creasing, respectively, the value of v: ur 
of four constant percentages: 5, 10, 15, ОГ agni- 
The three policies concerned with the „з | 
tude of rz; were simulated by setting 7+ 
to values which varied from —1.00 to 
in steps of 0.25. ply 
Calculations were made possible by li the 
ing the computer with initial values for 2 was 
parameters contained within the model. ices- 
initially given a value of 1.00. On each тир! 
sive calculation, the value of с WaS m set 
tuted for су. That is, оъ for any year W^ qe 
equal to the value of с; calculated 0 
basis of data from the previous year. 
Four initial values of c; were selecte 
the ratio c/c; initially represented а fu я 
of meaningful relations between the еї 
parameters. о/о, was assigned values 0 


d 50 that 


[| range 


thet 
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4, 4, .7, or 1.0 at the beginning of the 
computations. 

The effects of these various compensation 
programs were observed on two of the pa- 
rameters of pay, kpi and regen for successive 
periods in a 25-period span. It may be con- 
venient to think of the periods as years, but 
it is, of course, arbitrary. 

The results of each policy regarding s; were 
observed in combination with each of the 
policies regarding the value of rz and each of 
the initial ratios of c;/;. Thus, the total con- 
figuration was analogous to а completely 
crossed analysis-of-variance design with three 
factors: oj, rei, and о/о. The design can be 
described as a 9 X 9 X 4 design matrix and 
may be graphically represented as in Figure 25. 

For each cell of the matrix depicted in 
Figure 25 we have obtained 25 pairs of values 
Of скы and rigo. THEE ANA TRAD have been 
Plotted as a function of time for all 324 com- 
binations of treatments. Space limitations 
prevent presentation of the graphs of the 
а = all treatment combinations. How- 
ята US through 31 sample the design 
bini of eie the major findings on the 
Observe that 2 parameters тк and rige. 
миг а ; or each combination of policies 
à ые Tri and о; there are four curves 

g the effect of c/c; which demonstrate 
the short-run phenomenon we have named 
Convergence. From the point of view of the 
organization, the phenomenon of convergence 
for the curves of уш implies that the pre- 
dictive power of pay on pay on the succeeding 
year will not vary markedly after x number of 


years. 

"This same point can be restated in terms of 
its meaning for the individual. When con- 
vergence 15 reached, the probability of change 


in relative salary position will not change 


markedly. 


5 Although it is possible to derive algebraic solutions 
for the asymptote of many of the functions of rece) 
and оъ, and thereby demonstrate the similarity among 
the curves in terms of their behavior at finfinitys these 


mathematical abstractions have little meaning because 
the results must reflect the fact that the worker is 
employed for a limited period of time; from 25 to 50 yr. 
at most. Hence, the term “convergence” has been 
Selected to signify the apparent leveling off and con- 
verging of the curves over the short run. 
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Fic. 25. Schematic diagram of the variables considered 
and the specific values employed for computation. 


Effects of т 

The effects of rri upon 7k(k+i) CAN be clearly 
differentiated into those for rą 2 0.0 and 
those for 71: < 0.0. 

(a) When гь; > 0.0, it can be demonstrated 
algebraically that ria becomes asymptotic 
at a value of 1.00 as time goes to infinity. 
However, for the span of time investigated, the 
curves of rigo) level off, or converge, at a 
value less than 1.00, but always positive, 
depending upon the values of rzi While the 
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Tic. 26. Sample illustration of the variation of exi 
and rgi) as а function of time for various policies 
where raises (rz) = -25 and variation in pay (ei) is 
progressively decreased by 20% each year. (A family 
of curves represents different initial ratios of c/c. 
'The upper family of curves is the correlation of pay 
with pay. The lower family—hatched lines—is variation 


in pay-) 
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Fic. 27. Sample illustration of the variation of ox. 
and гин) as a function of time for various polic 
where raises (гы) = —.50 and variation in pay (¢,) is 
constant. (A family of curves represents different 
initial ratios of c;/c;. The upper family of curves is the 
correlation of pay with pay. The lower family—hatched 
lines—is variation in pay.) 


curves of rq; always converge, the time it 
takes to stabilize varies considerably as a 
function of rj, The higher the value of Thi, 
the faster the approach to a stable ri, 5. The 
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Fic. 28. Sample illustratio; 
and rig; as а function of time for 
where raises (лд) 
constant. i 


correlation of pay with pay. The lower family—hatcher 
lines—is variation in pay.) i 
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Fic. 29. Sample illustration of the variation of tpud 
and тыу as a function of time for various policies 
where raises (л) = .50 and variation in pay (oi) A 
constant. (A family of curves represents dim 
initial ratios of 7i/2;. The upper family of curves is йи 
correlation of pay with pay. The lower family —hatche 
lines—is variation in pay.) 


NS ё Р s when 
limiting case in this argument. occurs wh i 
74 = 1.00, under which circumstances ^+? 


immediately assumes a value of 1.00. 
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Fic. 30, Sample illustration of the variation of ces 
and лкы) as a function of time for various h (ai) ÍS 
where raises Cri) = —.25 and variation in P family 
Progressively increased by 10% each year. gilak 
of curves represents different initial ratios 0 of pay 
The upper family of curves is the correlation tion 
with pay. The lower family—hatched lines—1$ V“ 
In pay.) 
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Png that тъ has an asymptote of 1.00 
Р jy 0 icies R1 and R2 may be attributed to 
ү steady growth of т. The formula for 
Bon can be reduced to two parts: с/о 
Raus, At infinity the latter part is 
E ially equivalent to 0.0 while the former 
үш to 10. In common sense terms, 
ty n the dispersion between salaries gets very 
rge, relative monetary positions will remain 
M renes following the dispensation of raises 
Ке to the small size of ø; in relation to ox. 
5 hat is, even the largest raise will not be big 
nough to cause the interchange of salary 
Position within the group. i 
m eed ata level of rui) Close to 1.00 
eters the inevitability that the relative 
vill ied positions of the members of a group 
bes ea permanently fixed. This would 
tons f have profound motivational implica- 
ee died iag individual who must become 
ШЕ dup ot he fact that he will always occupy 
mu ү in terms of salary in relation 
Msrpesipen nployees, no matter how exceptional 
б) WI зен 

inet Pini He 0.0, the effects on ria. are 
the change j ent upon the policy regarding 
Бе In ог. The only general statement 
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Fic, 31. Sample illustrat 1 ок 
e for various policies 


and вы) as a function of tim e 
Where raises (r4) = -75 and variation in pay (e is 
Progressively increased by 20% each year. (A family 
9f curves represents different initial ratios of oilor 
The upper family of curves is the correlation of pay 
With pay, The lower family—hatched lines—is variation 
In pay.) í 
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Fic. 32. The mean level of convergence of ri q«i) AVET- 
aged across values of e; plotted as a function of rei. 


-.75 


that can be made is that the value of rrai) has 
fairly well stabilized after 25 yr.” The level at 
which convergence and relative stability occurs 
however, a function of the policy controlling 
the change in сг; that is, convergence occurs at 
a higher level of positive correlation for a 
given rz; as the compensation policy is varied 
from S3 to S1 to S2. 

Regardless of the policy controlling the 
change in е; over time, the greatest modifica- 
tion in the level of convergence of fri) for a 
given amount of change in rg; occurs when the 
value of rz; is negative. Figure 32 contains a 
plot of the magnitude of the level of conver- 
gence for 7р AS à function of rgi. Since the 
effects were similar across policies affecting тү, 
we have averaged the levels of convergence 
across Policies S1, S2, and S3. 

If it is assumed that recognition of a change 
in the stability of relative salaries is directly 


is, 


т For example, the asymptote for гы) when rjj 
< 0.0 and Policy S1 prevails is: ria,» = 1 — 27%. 


ГЄ] 
[Ж] 


related to the amount of actual change in the 
level of convergence, then it might be hy- 
pothesized that, in psychophysical parlance, 
more JNDs in stability will be perceived in the 
process of varying the value of гь; from —0.75 
to —0.50 than for any other comparable 
amount of change in rg; The implications of 
this fact for the salary administrator would 
seem to be that costs of varying the amount of 
perceived stability in Tro; Would be greatest 
for companies who pursue R1 policies, cost 
being measured in terms of the change required 
in rg; to produce the effect desired. For ex- 
ample, knowledge that ғ; has been equal to 
0.70 for a number of years makes any attempt 
to raise riu; to a higher level seem un- 
economical since increasing the value of Tki 
will have little effect on Tki) in this range. 

The effect of r;; on ткы Can also be sub- 
divided on the basis of the Sign and magnitude 
of Tki. 

(а) rz: > 0.0. Under Policies R1 and R2 the 
value of скы is a steadily increasing function 
over time. A brief look at the formula for ткы? 
will explain these results. Because c? is an 
additive component, Tie? will always increase 
whenever there is variance in the increments. 
When r;; is Zero, the amount of this increase 
is simply equal to с. However, as rp; assumes 
larger positive values, the increase in the 
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variance of pay will be a function of т plus 
the covariance term, 2s;o;r;;. | 

It is clear that the variance of pay will not 
change if there is no variance in the increments 
awarded (i.e., e; = 0.0), regardless of the value 
of 7. This follows from the mathematical rule 
that the variance of a distribution remains b«c 
changed if a constant is added or subtracte 
from each score in the sample. f 

(b) ть < 0.0. Under Policy R3 the level 9 
9+: CONVerges instead of steadily increasing or 
decreasing. The level of convergence is in some 
cases higher than the initial value of c; despite 
the negative covariance term produced by 7 й. 

Algebraically, it can be demonstrated tha 
whenever r;; is less than 0.0, and Policy mL 
in effect, the curve of ткы becomes asymptot* 
at a value determined from the following 
formula: ты = cgi/ —2ryg. 


Effects of с; 


Regardless of the policy concerning "rù E 
was found that the level of convergence vr 
"еро decreases as the value of с; is prag. 
sively enlarged from one year to the пес” 
Figure 33 is a plot of the mean level of СО 
vergence for each of the nine Jevels of the i 
factor when the results are averaged across : 
Tx: policies. The narrow range of convergen? 
levels of rig, for the different amounts nt 
change in с; indicates that the average et 
of stability in relative monetary position E 
not vary a great deal for different police 
controlling о, m 

As indicated earlier, since оу is an additive 
component of x41, the greater the increas a 
Ti, the greater the value of с. That 15, p» 
given amount of time, regardless of the pO" 
controlling у, Ты Will be larger under 2" 
Policy than either an S1 or S3 policy. 


Effects of c ifo, 


Regardless of the ratio of c; to ox of ed 
original or starting salaries, the curves ol 7* does 
will eventually converge, That is, &;/6* ary 
not differentially affect relative mone 
Status of individuals with the passage ne 
Sufficient time, However, the amount 0 aay 
required by 7, о-о to achieve stability will ‚ {0 
as a function of тек. The time necessa? ce 
reach the leve] of Trapi at which convers 
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occurs is increased when o;/ox is increased for 
ты > 0.0, whereas the time is decreased when 
7i/c; is increased and г; < 0.0. 

As has been noted previously, it is readily 
apparent from the formula that the value of 
7/4; is directly related to the size of c; It is 
not surprising then that the larger values of 
7;/c, were associated with the higher values 
9 ац for all treatment combinations. 

These findings indicate that the motivational 
leverage inherent in e; would have to have its 
effect through broadening the range of ex- 
Dected pay. The effect of e;/c; on the correla- 
Чоп of salaries on successive years is negligible 
Since the same amount of relative stability is 
achieved regardless of the value of ост. 


DISCUSSION 


A model of this kind sorts out and clarifies 
nip of specific variables which turn up 
is com ле heading of pay. Unfortunately, pay 
feront the authors cannot accept any 
tion асі са the portion of the complica- 
the variety M ge in the real world. Restating 
plication woul eoe: р within this com- 
research. and М ѕеет (0 һеїр make future 
addition: conceptualizations specific. In 


gr The salary administration may want to 
TE nge either: (a) the employee's feeling that 

can get ahead (relatively), or (b) the size 
of the jump in the employee's aspiration. The 
first he does by policies influencing тъ; the 
Second by policies influencing ткт. 

If he wants an employee to feel that he can 
get ahead (relatively), the administrator 
remembers: 
so that it is 20.0, лн 
to 1.0. 

(ria) will 


Д. If he manages 7i 
will, eventually, be asymptotic 

2. Stability of relative position 
be higher, the higher rzi 

3. It will stabilize sooner, the 
; 4. If he operates rri at 0.0, sta 
largely influenced by ai. It will be 
Is constant or decreasing over time, 
Increases steadily. "" 

5. The ratio of azor Wil have а negligible 
effect on the level at which 7+? stabilizes. . 
. 6. Stability in кн 0CCUIS sooner if с/с 15 
increased and у < 0.0 and later if rri 2 0. 


higher rri- 

bility will be 
higher if c; 
lower if v; 
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If he wants to broaden aspirations (ты): 


. Obviously, it depends on the size of сє. 
. Variation increases faster if rz; > 0.0. 
. It increases faster, the higher rgi- 
4. If гь < 0.0, variation tends to become 
stable. 


1 
2 
3 


The administrator seeking to maximize а 
feeling of opportunity and high aspirations has 
a problem. If he lets г; get high, т: goes up 
and the employee has wider aspirational 
horizons. However, 7,4: tends to rise, and the 
probability that the employee will advance 
relative to others diminishes. On the other 
hand, increasing c; systematically will both 
raise grp: and lower т, presumably what 
he wanted. He may be comfortable with the 
assumption that the range of performance (and 
hence е) increases, but deliberately lowering 
is disturbing. Common sense and 
experience suggest that repeated measures of 
performance tend to be correlated. Further, 
one likes to think that eventually—with ex- 
perience with people on jobs—pay will predict 
pay. He has had to relax both these notions. 
Moreover, as сть Increases across levels, it has 
real implications for the spread of the organiza- 
tion. It is indeed a difficult situation. Perhaps 
that is why salary administrators’ own salaries 
tend to be high. 

IL In the process of providing guide lines 
for controlling the administration of salaries, 
the focus has been shifted to those variables 
which are most appropriately manipulated in 
order to attain specific objectives. Many salary 
administrators concern themselves solely with 
the adjustment of the amount of raises, that 
is, 1. It is clear that the only thing which is 
directly affected by this is Ẹ. Many discussions 
of equity (Adams, 1963; Jaques, 1961) have 
indicated that the absolute amount of salary 
is in itself comparatively unimportant without 
also considering the relative salaries of refer- 
ence groups. Since the effect of 7 on the more 
crucial dependent variables in the model is 
only through its empirically determined cor- 
relation with one of the other parameters in 
each particular situation, it would appear that 
more effective control of salaries could be 
achieved by manipulation of е; and Tki 

III. In this connection it is suggested that 
the compensation policy be controlled. by 


ri; and ri cci 
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means of adjustments in c; rather than г. с: 
clearly is a more manageable variable. Whereas 
one may be able to judge roughly the manner 
in which raises should be distributed among 
present salary levels in order to approximate 
the desired magnitude of гь, precise manipula- 
tion of this parameter is difficult in practice. 
There is no known algorithm with which to 
determine the exact method of awarding incre- 
ments in order to produce a desired level of гь. 
However, the results in terms of the level of 
convergence of лкы) are much alike for a 
wide range of rpi. А 

IV. The model has also provided a possible 
explanation of the conflict Which we noted in 
Chapter 2 between our results and those of 
Brenner and Lockwood (1965) on the behavior 
ОЁ ricci) With increases fr*tentre. Brenner and 
Lockwood found evidence to Support the 
notion that the correlation between salaries 


is, it was noted that 
When rj; > 0.0 for all levels of Policies S1 and 


98, пон) increased Over each suc 
of time. However, when The 
upon the values 


ifferences in Tki prod 
uc 
results on the te lie m 
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changes. The need is quite apparent for a g 
deal of additional work on the relationshi 
the parameters of pay to variables conne 
with perception, attitudes, and motivation. 
these future research undertakings, the m 
apparently would be useful in operationaliz 
those aspects or constructs of pay which sho 
Serve as experimental variables, 

It should be emphasized, however, that 
existence of the model will not surmount 
the obstacles in the:path of methodologic 
Sound and persüasive research. Many o 
Problems which have been mentioned he 
such as sampling difficulties, the use of termi 
criteria, and management's chronic relucta 
to releasc salary data, will continue to pla£ 
researchers concerned with compensation 
search. Better experimental design and mé 
careful collection of data are problems whi 
can only be overcome by means-of a compl 
reorientation in the philosophy of resear 
Promoted by the psychologist and adopted 
those agencies or companies that spons 
research. à 
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